-- Logs begin at Wed 2022-08-24 02:44:19 UTC, end at Wed 2022-08-24 04:14:31 UTC. -- Aug 24 03:43:06.564342 dv-cinder-854260-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 03:43:06.571642 dv-cinder-854260-1-iscsi devstack@n-api.service[112817]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 03:43:06.573611 dv-cinder-854260-1-iscsi devstack@n-api.service[112817]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 03:43:06 2022] *** Aug 24 03:43:06.573611 dv-cinder-854260-1-iscsi devstack@n-api.service[112817]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 03:43:06.573611 dv-cinder-854260-1-iscsi devstack@n-api.service[112817]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 03:43:06.573611 dv-cinder-854260-1-iscsi devstack@n-api.service[112817]: nodename: dv-cinder-854260-1-iscsi Aug 24 03:43:06.573611 dv-cinder-854260-1-iscsi devstack@n-api.service[112817]: machine: x86_64 Aug 24 03:43:06.573611 dv-cinder-854260-1-iscsi devstack@n-api.service[112817]: clock source: unix Aug 24 03:43:06.573611 dv-cinder-854260-1-iscsi devstack@n-api.service[112817]: pcre jit disabled Aug 24 03:43:06.573611 dv-cinder-854260-1-iscsi devstack@n-api.service[112817]: detected number of CPU cores: 4 Aug 24 03:43:06.574142 dv-cinder-854260-1-iscsi devstack@n-api.service[112817]: current working directory: / Aug 24 03:43:06.574142 dv-cinder-854260-1-iscsi devstack@n-api.service[112817]: detected binary path: /usr/bin/uwsgi-core Aug 24 03:43:06.574142 dv-cinder-854260-1-iscsi devstack@n-api.service[112817]: your processes number limit is 47680 Aug 24 03:43:06.574142 dv-cinder-854260-1-iscsi devstack@n-api.service[112817]: your memory page size is 4096 bytes Aug 24 03:43:06.574142 dv-cinder-854260-1-iscsi devstack@n-api.service[112817]: detected max file descriptor number: 2048 Aug 24 03:43:06.574142 dv-cinder-854260-1-iscsi devstack@n-api.service[112817]: lock engine: pthread robust mutexes Aug 24 03:43:06.574142 dv-cinder-854260-1-iscsi devstack@n-api.service[112817]: thunder lock: enabled Aug 24 03:43:06.574142 dv-cinder-854260-1-iscsi devstack@n-api.service[112817]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 03:43:06.574142 dv-cinder-854260-1-iscsi devstack@n-api.service[112817]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 03:43:06.614618 dv-cinder-854260-1-iscsi devstack@n-api.service[112817]: Python main interpreter initialized at 0x562974f2a9c0 Aug 24 03:43:06.614618 dv-cinder-854260-1-iscsi devstack@n-api.service[112817]: python threads support enabled Aug 24 03:43:06.614618 dv-cinder-854260-1-iscsi devstack@n-api.service[112817]: your server socket listen backlog is limited to 100 connections Aug 24 03:43:06.614618 dv-cinder-854260-1-iscsi devstack@n-api.service[112817]: your mercy for graceful operations on workers is 90 seconds Aug 24 03:43:06.614987 dv-cinder-854260-1-iscsi devstack@n-api.service[112817]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 03:43:06.615052 dv-cinder-854260-1-iscsi devstack@n-api.service[112817]: *** Operational MODE: preforking *** Aug 24 03:43:06.615403 dv-cinder-854260-1-iscsi devstack@n-api.service[112817]: *** uWSGI is running in multiple interpreter mode *** Aug 24 03:43:06.615403 dv-cinder-854260-1-iscsi devstack@n-api.service[112817]: spawned uWSGI master process (pid: 112817) Aug 24 03:43:06.615607 dv-cinder-854260-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 03:43:06.617173 dv-cinder-854260-1-iscsi devstack@n-api.service[112817]: spawned uWSGI worker 1 (pid: 112818, cores: 1) Aug 24 03:43:06.617173 dv-cinder-854260-1-iscsi devstack@n-api.service[112817]: spawned uWSGI worker 2 (pid: 112819, cores: 1) Aug 24 03:43:06.617173 dv-cinder-854260-1-iscsi devstack@n-api.service[112817]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 03:43:07.288863 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 03:43:07.296606 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 03:43:08.395182 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:43:08.395182 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: from cryptography.utils import int_from_bytes Aug 24 03:43:08.395745 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:43:08.395745 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: from cryptography.utils import int_from_bytes Aug 24 03:43:08.400454 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:43:08.400454 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: from cryptography.utils import int_from_bytes Aug 24 03:43:08.400897 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:43:08.400897 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: from cryptography.utils import int_from_bytes Aug 24 03:43:10.918654 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 03:43:10.919318 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 03:43:10.919405 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 03:43:10.919742 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 03:43:10.919828 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 03:43:10.919904 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 03:43:10.919980 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 03:43:10.920048 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 03:43:10.920293 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 03:43:10.920402 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.920547 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 03:43:10.920701 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.920932 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.921026 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.921261 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.921357 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.921584 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.921687 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.921904 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.922003 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.922227 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.922315 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.922559 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.922661 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.922884 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.923009 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.923213 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.923402 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.923549 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.923700 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.923792 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.923889 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854260-1-iscsi {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.924081 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.924187 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.924401 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854260-1-iscsi {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.924492 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.924721 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.924819 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.925027 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.925158 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.925336 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.925471 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.925655 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.925790 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.925959 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.926091 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.926279 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.926524 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.926681 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.926911 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.927109 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.927221 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.927421 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.927528 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.927726 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.927823 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.928036 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.928137 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.928373 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.928484 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.928682 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.928768 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.928991 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.929076 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.929311 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.929406 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.929619 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.929714 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.929944 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.930035 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854260-1-iscsi {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.930257 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.930360 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.930658 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.930767 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854260-1-iscsi {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.930973 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.931073 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.931286 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.931390 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.931597 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.931773 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.932004 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.932100 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.932312 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.932398 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.932623 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.932707 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.932942 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.933035 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.933357 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.933451 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.933777 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.933870 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.934111 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.934218 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.934483 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.934635 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.934827 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.934929 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.935151 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.935248 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.935458 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.935543 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.935770 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.935855 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.936081 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.936174 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.936403 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.936498 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.936654 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.936751 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.936966 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.937067 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.937243 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.937328 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.937552 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.937649 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.937875 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.937969 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.938147 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.938231 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.938405 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.938623 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.938733 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.938809 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.939006 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.939100 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.939324 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.939441 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.939644 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.939737 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.939949 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.940051 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.940254 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.940352 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.940560 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.940658 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.940865 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.940961 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.941169 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.941261 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.941473 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.941563 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.941778 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.941870 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.942085 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.942183 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.942400 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.942518 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.942734 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.942820 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.943056 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.943141 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.943364 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.943498 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.82 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.943683 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.943769 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.82 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.943990 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.944080 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.82 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.944318 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.82 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.944402 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.944624 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.944712 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.944933 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.945018 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.945253 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.945339 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.945561 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.945658 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.945872 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.945956 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.946182 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.946303 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.946489 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.946618 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.946814 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.946913 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.947127 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.947219 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.947447 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.947547 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.947700 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.947795 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.948043 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.948133 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.948301 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.948398 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.948602 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.948698 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.948930 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.949106 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.949285 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.949426 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.949637 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.949762 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.949949 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.950048 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.950258 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.950352 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.950579 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.950667 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.950890 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.950984 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.951196 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.951288 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.951503 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.951589 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.951808 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.951894 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.952114 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.952239 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.952417 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.952503 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.952722 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.952806 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.953022 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.953106 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.953324 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.953415 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.953643 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.953737 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.953946 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.954020 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.954253 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.954343 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.954614 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.954722 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.954879 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.954967 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.955184 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.955276 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.955488 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.955586 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.955791 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.955876 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.956095 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.956179 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.956398 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.956496 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.956701 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.956785 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.957010 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.957102 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.957315 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.957480 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.957621 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.957705 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.957923 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.958008 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.958230 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.958322 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.958545 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.958644 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.958860 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.958968 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.959166 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.959268 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.959471 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.959556 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.959773 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.959856 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.960072 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.960156 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.960375 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.960459 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.960675 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.960766 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.960975 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.961059 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.961273 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.961404 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.961574 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.961660 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.961871 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.961957 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.962185 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.962277 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.962494 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.962630 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.962823 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.962910 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.963127 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.963223 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.963430 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.963515 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.963747 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:43:10.963834 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.964082 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.964175 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.964956 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.965128 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.965267 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.965556 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.965642 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.965889 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.965986 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.966226 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.966314 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.966585 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.966674 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.966909 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.967007 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.967223 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.967314 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.967533 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.967625 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.967847 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.967941 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.968161 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.968245 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.968474 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.968558 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.968786 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.968892 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.969109 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.969214 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.969424 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.969517 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.969741 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.969834 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.970053 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.970147 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.970369 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.970461 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.970724 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.970825 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.971034 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.971119 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.971348 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.971439 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.971676 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.971769 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.971996 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.972082 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.972308 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.972394 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.972640 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.972736 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.972969 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.973056 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.973283 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.973374 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.973596 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.973696 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.973909 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.973996 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.974219 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.974304 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.974547 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.974640 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.974860 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.974964 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.975182 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.975271 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.975497 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.975585 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.975811 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.975898 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.976125 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.976218 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.976434 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.976520 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.976746 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.976874 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.977058 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.977157 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.977376 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.977462 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.977688 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.977773 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.978000 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.978092 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.978319 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.978405 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.978655 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.978741 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.978969 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.979065 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.979284 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.979386 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.979587 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.979670 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.979893 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.980018 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.980799 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.981028 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.981110 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.981263 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.981436 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.981658 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.981754 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.981834 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.981991 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.982157 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.982296 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.982471 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.982640 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.982838 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.982971 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.983151 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.983279 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.983467 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.983613 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.983782 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.983920 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.984097 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.984233 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.984406 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.984544 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.984724 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.984856 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.985039 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.985174 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.985348 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.985444 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.985677 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.985766 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.985992 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.986090 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.986299 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.986391 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.986650 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.986740 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.986962 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.987061 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.987270 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.987358 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.987581 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.987665 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.987887 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.987974 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.988198 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.988282 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.988506 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.988589 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.988815 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.988901 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.989124 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.989215 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.989438 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.989544 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.989747 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.989831 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.990062 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.990147 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.990376 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.990472 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.990722 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.990820 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.991050 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.991144 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.991353 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.991446 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.991679 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.991765 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.991982 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.992075 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.992296 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.992390 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.992604 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.992688 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.992915 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.993001 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.993220 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.993313 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.993527 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.993613 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.993829 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.993913 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.994138 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.994225 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.994442 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.994547 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.994775 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.994859 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.995081 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.995167 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.995389 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.995477 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.995732 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.995823 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.996078 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.996172 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.996485 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.996917 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.997002 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.997090 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.997090 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.997235 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.997398 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.997485 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.998757 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.998919 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.998919 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.999130 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.999235 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.999340 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.999340 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.999648 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.999760 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:10.999760 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.001207 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.001312 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.001312 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.001517 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.001622 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.001725 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.001828 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.001939 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.002051 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.002156 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.002259 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.002362 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.002465 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.002600 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.002719 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.002824 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.002927 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.003030 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.003141 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.003245 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.003362 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.003467 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.003570 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.003681 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.003864 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.003970 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.004087 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.004192 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.004296 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.004400 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.004503 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.004622 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.004622 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.004816 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.004919 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.005020 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.005149 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.005271 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.005459 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.005572 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.005801 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.005935 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.006083 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.006184 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.006396 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.006489 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.006729 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.006815 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.007044 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.007140 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.007361 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.007447 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.007670 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.007754 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.007987 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.008085 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.008296 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.008380 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.008611 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.008695 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.008913 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.008998 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.009229 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.009315 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.009536 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.009642 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.009858 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.009956 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.010159 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.010260 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.010470 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.010573 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.010819 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.010908 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.011130 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.011216 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.011506 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.011594 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.011879 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.012095 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.012180 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.012432 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.012525 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.012749 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.012836 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.013066 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.013151 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.013380 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.013465 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.013689 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.013775 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.013999 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.014127 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.014313 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.014403 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.014647 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.014751 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.014957 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.015051 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.015266 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.015361 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.015578 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.015688 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.015884 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.016008 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.016197 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.016464 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.016557 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.016770 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.016871 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.017080 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.017215 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.017402 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.017520 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.017723 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.017836 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.018035 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.018149 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.018341 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.018455 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.019172 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.019259 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.019339 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.019430 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.019430 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.019676 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.019764 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.019860 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.019940 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.020027 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.020174 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.020284 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.020483 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.020581 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.020785 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.020880 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.021107 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.021199 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.021420 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.021514 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.021722 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.021807 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.022039 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.022124 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.022353 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.022437 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.022686 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.022774 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.023002 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.023088 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.023310 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.023394 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.023619 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.023706 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.023930 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.024014 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.024241 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.024337 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.024550 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.024637 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.024862 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.024945 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.025169 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.025261 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.025473 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.025558 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.025780 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.025863 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.026098 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.026190 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.026405 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.026713 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.026815 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.027838 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.027937 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.028188 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.028288 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.028463 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.028564 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.028782 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.028878 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.029196 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.029353 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.029531 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.029688 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.029862 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.030005 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.030227 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.030371 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.030538 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.030672 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.030857 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.030955 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.031165 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.031284 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.031473 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.031613 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.031785 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.031951 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.032094 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.032257 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.032403 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.032568 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.032717 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.032874 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.033030 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.033179 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.033340 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.033488 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.033650 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.033792 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.033959 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.034094 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.034268 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.034397 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.034608 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.034730 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.034919 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.035035 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.035234 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.035327 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.035542 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.035635 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.035867 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.035956 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.036178 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.036271 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.036485 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.036570 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.036791 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.036878 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.037098 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.037185 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.037422 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.037507 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.037731 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.037818 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.038040 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.038129 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.038342 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.038429 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.038670 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.038760 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.039017 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.039103 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.039326 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.039422 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.039652 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.039737 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.039961 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.040048 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.040270 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.040365 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.040575 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.040660 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.040886 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.040971 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.041198 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.041292 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.041503 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.041589 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.041805 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.041889 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.042110 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.042203 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.042419 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.043245 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.043337 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.043446 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.043576 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.043722 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.043895 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.044037 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.044208 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.044345 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.044519 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.044662 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.044827 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.044974 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.045132 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.045281 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.045440 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.045588 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.045744 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.045898 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.046060 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.046209 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.046351 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.046534 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.046665 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.046864 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.046970 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.047159 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.047263 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.047477 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.047565 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.047785 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.047873 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.048090 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.048179 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.048396 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.048492 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.048710 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.048806 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.049023 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.049120 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.049325 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.049411 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.049630 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.049725 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.049938 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.050027 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.050244 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.050330 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.050566 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.050679 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.050877 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.050964 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.051184 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.051272 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.051487 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.051587 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.051793 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.051883 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.052101 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.052188 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.052405 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.052507 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.052708 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.052803 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.053016 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.053110 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.053320 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.053414 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.053631 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.053780 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.053913 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.054048 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.054224 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.054365 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.054546 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.054645 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.054842 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.054927 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.055143 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.055228 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.055449 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.055534 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.055755 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.055855 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.056058 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.056170 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.056403 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.056525 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.056660 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.056750 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.056961 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.057059 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.057266 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.057350 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.057577 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.057675 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.057886 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.057972 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.058230 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.058323 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.058730 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.058843 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.059031 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.059117 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.059345 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.059428 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.059658 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.059752 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.059975 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.060067 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.060290 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.060376 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.060596 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.060744 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.060912 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.060999 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.061225 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.061309 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.061536 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.061630 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.061840 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.061925 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.062144 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.062228 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.062455 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.062564 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.062796 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.062882 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.063102 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.063255 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.063407 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.063728 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.063861 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.064044 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.064358 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.064442 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.064787 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.064874 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.065145 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.065379 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.065466 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.065772 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.065998 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.066084 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.066387 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.066612 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.066895 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.067014 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.067218 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.067390 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.067536 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.067720 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.067854 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.068045 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.068175 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.068369 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.068493 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.068690 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.068812 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.069071 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.069170 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.069434 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.069655 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.069742 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.070044 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.070240 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.070357 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.070694 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.070863 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.071004 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.071340 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.071495 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.071643 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.071792 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.071989 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.072078 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.072312 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.072565 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.072651 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.072949 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.073146 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.073265 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.073729 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.074430 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.074657 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.074885 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.075055 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.075469 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.075598 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.075799 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.076126 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.076218 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.076447 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.076720 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.076815 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.077078 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.077267 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.077404 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.077658 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.077757 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.077974 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.078068 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.078404 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.078489 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.078753 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.078864 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.079075 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.079169 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.079391 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.079475 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.079701 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.079786 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.080006 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.080090 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.080319 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.080403 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.080642 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.080728 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.080949 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.081033 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.081251 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.081335 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.081557 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.081643 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.081881 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.081965 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.082188 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.082281 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.082524 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.082625 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.082956 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.083041 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.083269 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.083362 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.083574 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.083659 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.083993 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.084077 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.084306 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.084398 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.084618 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.084702 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.084939 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.085031 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.085264 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.085357 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.085587 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.085680 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.085893 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.086000 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.086207 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.086294 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.086530 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.086637 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.086866 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.086952 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.087190 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.087276 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.087502 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.087596 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.087818 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.087902 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.088122 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.088216 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.088449 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.088544 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.088770 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.088855 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.089082 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.089166 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.089449 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.089538 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.089911 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.089996 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.090301 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.090387 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.090661 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.091377 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.091522 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.091723 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.091811 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.092056 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.092157 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.092369 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.092457 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.092679 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.092765 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.092993 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.093081 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.093302 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.093388 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.093608 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.093693 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.093923 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.094008 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.094230 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.094315 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.094561 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.094660 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.094876 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.094964 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.095183 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.095276 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.095490 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.095576 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.095814 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.095902 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.096121 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.096207 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.096429 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.096522 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.096748 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.096879 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.097060 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.097183 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.097384 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.097482 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.097690 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.097775 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.098003 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.098088 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.098313 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.098406 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.098649 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.098739 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.098956 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.099149 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.099265 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.099362 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.099572 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.099663 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.099908 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.099993 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.100214 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.100300 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.100537 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.100631 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.100869 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.100956 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.101180 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.101266 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.101498 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.101627 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.101833 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.101935 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.102154 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.102241 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.102473 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.102579 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.102823 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.102922 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.103131 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.103218 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.103440 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.103526 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.103740 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.103833 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.104047 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.104132 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.104348 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.104432 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.104653 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.104747 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.104956 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.105061 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.105294 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.105453 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.105662 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.106059 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.106162 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.106243 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.106367 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.106556 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.106706 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.106892 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.107123 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.107325 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.107466 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.107551 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.107650 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.107811 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.107922 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.108117 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.108231 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.108424 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.108578 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.108734 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.108890 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.109078 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.109224 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.109385 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.109543 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.109717 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.109871 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.110028 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.110192 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.110353 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.110566 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.110699 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.110860 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.111019 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.111181 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.111341 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.111502 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.111661 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.111823 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.111981 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.112142 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.112301 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.112454 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.112619 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.112781 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.112930 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.113101 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.113246 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.113419 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.113563 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.113883 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.113967 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.114302 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.114434 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.114646 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.114792 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.114966 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.115109 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.115285 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.115423 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.115605 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.115737 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.115922 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.116053 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.116239 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.116368 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.116556 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.116680 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.116871 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.116990 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.117187 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.117303 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.117519 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.117616 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.117845 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.117941 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.118174 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.118268 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.118537 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.118638 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.118861 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.118961 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.119179 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.119272 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.119497 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.119591 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.119814 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.119912 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.120129 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.120215 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.120478 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.120563 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.120830 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.120948 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.121141 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.121397 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.121485 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.121720 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.121798 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.122041 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.122127 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.122353 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.122438 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.122691 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.122788 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.123006 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.123092 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.123317 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.123403 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.123629 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.123717 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.123942 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.124029 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.124257 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.124342 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.124571 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.124659 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.124896 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.124983 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.125232 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.125327 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.125552 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.125637 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.125863 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.125947 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.126175 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.126275 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.126490 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.126622 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.127034 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.127172 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.127354 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.127451 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.127693 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.127779 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.128023 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.128117 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.128352 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.128484 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.128673 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.128758 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.128992 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.129076 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.129320 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.129406 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.129627 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.129712 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.129931 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.130016 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.130242 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.130328 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.130573 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.130661 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.130883 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.130967 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.131206 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.131293 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.131518 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.131603 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.131823 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.131979 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.132144 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.132229 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.132452 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.132536 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.132984 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.133080 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.133335 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.133423 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.133654 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.133741 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.133983 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.134082 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.134311 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.134396 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.134659 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.134749 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.134970 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.135067 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.135297 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.135391 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.135605 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.135698 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.135911 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.135997 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.136736 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.136908 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.137043 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.137169 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.137354 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.137622 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.137708 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.138038 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.138361 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.138448 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.138708 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.138975 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.139062 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.139324 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.139635 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.139955 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.140050 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.140267 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.140352 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.140577 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.140663 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.140887 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.140975 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.141201 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.141287 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.141508 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.141594 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.141816 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.141902 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.142122 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.142214 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.142430 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.142583 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.142765 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.142862 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.143070 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.143163 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.143374 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.143459 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.143682 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.143776 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.143987 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.144072 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.144289 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.144386 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.144595 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.144680 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.144899 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.144984 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.145202 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.145300 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.145515 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.145602 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.145821 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.145906 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.146147 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.146242 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.146495 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.146618 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.146812 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.146911 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.147127 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.147223 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.147443 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.147529 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.147765 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.147857 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.148082 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.148169 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.148396 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.148625 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.148747 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.148964 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.149063 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.149291 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.149591 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.149677 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.149932 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.150024 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.150245 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.150339 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.150576 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.150666 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.150887 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.150973 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.151216 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.151311 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.151523 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.151608 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.151831 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.152763 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.152950 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.153134 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.153267 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.153455 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.153584 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.153778 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.153900 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.154093 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.154213 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.154409 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.154546 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.154752 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.154865 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.155064 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.155193 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.155378 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.155473 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.155692 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.155787 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.156005 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.156090 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.156317 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.156477 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.156630 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.156717 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.156947 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.157032 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.157261 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.157354 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.157577 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.157662 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.157905 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.157989 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.158224 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.158312 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.158565 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.158668 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.158877 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.158969 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.159191 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.159279 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.159500 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.159592 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.159809 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.159894 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.160123 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.160215 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.160435 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.160521 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.160755 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.160850 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.161059 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.161151 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.161388 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.161473 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.161697 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.161791 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.162091 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.162175 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.162416 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.162526 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.162756 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.162859 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.163080 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.163173 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.163392 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.163486 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.163710 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.163803 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.164034 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.164128 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.164344 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.164429 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.164667 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.164754 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.164980 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.165066 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.165312 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.165405 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.165637 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.165722 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.165945 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.166030 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.166251 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.166336 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.166579 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.166668 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.166894 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.166979 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.167200 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.167297 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.167540 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.167657 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.167841 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.167918 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.168149 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.168283 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.168456 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.168542 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.168807 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.168906 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.169067 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.169163 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.169372 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.169456 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.169674 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.169758 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.169983 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.170069 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.170287 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.170371 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.170618 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.170707 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.170924 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.171010 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.171227 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.171310 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.171530 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.171614 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.171831 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.171916 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.172133 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.172217 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.172437 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.172522 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.172744 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.172838 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.173046 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.173132 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.173348 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.173441 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.173654 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.173741 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.173959 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.174052 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.174262 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.174356 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.174622 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.174712 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.174946 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.175040 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.175258 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.175357 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.175580 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.175664 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.175889 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.175981 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.176212 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.176306 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.176524 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.176610 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.176839 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.176931 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.177152 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.177238 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.177466 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.177550 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.177777 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.177871 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.178089 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.178181 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.178401 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.178486 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.178738 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.178831 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.179048 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.179141 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.179358 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.179442 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.179673 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.179759 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.179988 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.180074 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.180299 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.180383 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.180630 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.180724 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.180934 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.181018 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.181260 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.181345 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.181578 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.181677 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.181894 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.181980 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.182210 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.182301 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.182542 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.182644 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.182860 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.182952 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.183199 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.183301 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.183518 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.183732 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.183847 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.183932 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.184163 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.184248 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.184478 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.184564 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.184796 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.184889 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.185109 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.185195 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.185424 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.185555 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.185739 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.185825 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.186058 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.186154 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.186370 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.186454 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.186726 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.186815 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.187037 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.187130 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.187367 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.187452 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.187694 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.187781 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.188036 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.188134 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.188352 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.188482 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.188667 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.188762 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.188984 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.189070 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.189291 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.189378 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.189539 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 03:43:11.189624 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.189913 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:43:11.190159 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 03:43:11.345736 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO dbcounter [None req-75fbe75f-9a8b-44c4-a52e-5eddf78febb2 None None] Registered counter for database nova_api Aug 24 03:43:11.346637 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO dbcounter [None req-6ccec6b4-7c4a-4f09-8d4f-652bd880f9c4 None None] Registered counter for database nova_api Aug 24 03:43:11.367540 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG oslo_db.sqlalchemy.engines [None req-75fbe75f-9a8b-44c4-a52e-5eddf78febb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112819) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:43:11.369106 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG oslo_db.sqlalchemy.engines [None req-6ccec6b4-7c4a-4f09-8d4f-652bd880f9c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112818) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:43:11.374975 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG dbcounter [-] [112819] Writer thread running {{(pid=112819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:43:11.375918 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG dbcounter [-] [112818] Writer thread running {{(pid=112818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:43:11.431857 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.context [None req-6ccec6b4-7c4a-4f09-8d4f-652bd880f9c4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a161133a-c4eb-4e12-9be8-d257b8daa02d(cell1) {{(pid=112818) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 03:43:11.432037 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.context [None req-75fbe75f-9a8b-44c4-a52e-5eddf78febb2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a161133a-c4eb-4e12-9be8-d257b8daa02d(cell1) {{(pid=112819) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 03:43:11.436342 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG oslo_concurrency.lockutils [None req-6ccec6b4-7c4a-4f09-8d4f-652bd880f9c4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:11.436654 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG oslo_concurrency.lockutils [None req-75fbe75f-9a8b-44c4-a52e-5eddf78febb2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:11.436807 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG oslo_concurrency.lockutils [None req-6ccec6b4-7c4a-4f09-8d4f-652bd880f9c4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:11.437130 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG oslo_concurrency.lockutils [None req-75fbe75f-9a8b-44c4-a52e-5eddf78febb2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:11.438356 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG oslo_concurrency.lockutils [None req-6ccec6b4-7c4a-4f09-8d4f-652bd880f9c4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:11.438742 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG oslo_concurrency.lockutils [None req-75fbe75f-9a8b-44c4-a52e-5eddf78febb2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:11.439109 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG oslo_concurrency.lockutils [None req-6ccec6b4-7c4a-4f09-8d4f-652bd880f9c4 None None] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:11.439467 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG oslo_concurrency.lockutils [None req-75fbe75f-9a8b-44c4-a52e-5eddf78febb2 None None] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:11.439572 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG oslo_concurrency.lockutils [None req-6ccec6b4-7c4a-4f09-8d4f-652bd880f9c4 None None] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:11.439912 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG oslo_concurrency.lockutils [None req-75fbe75f-9a8b-44c4-a52e-5eddf78febb2 None None] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:11.441493 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG oslo_concurrency.lockutils [None req-6ccec6b4-7c4a-4f09-8d4f-652bd880f9c4 None None] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:11.441886 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG oslo_concurrency.lockutils [None req-75fbe75f-9a8b-44c4-a52e-5eddf78febb2 None None] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:11.443512 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO dbcounter [None req-6ccec6b4-7c4a-4f09-8d4f-652bd880f9c4 None None] Registered counter for database nova_cell0 Aug 24 03:43:11.443899 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO dbcounter [None req-75fbe75f-9a8b-44c4-a52e-5eddf78febb2 None None] Registered counter for database nova_cell0 Aug 24 03:43:11.449913 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO dbcounter [None req-6ccec6b4-7c4a-4f09-8d4f-652bd880f9c4 None None] Registered counter for database nova_cell1 Aug 24 03:43:11.450153 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO dbcounter [None req-75fbe75f-9a8b-44c4-a52e-5eddf78febb2 None None] Registered counter for database nova_cell1 Aug 24 03:43:11.457929 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG oslo_db.sqlalchemy.engines [None req-75fbe75f-9a8b-44c4-a52e-5eddf78febb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112819) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:43:11.460765 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG oslo_db.sqlalchemy.engines [None req-75fbe75f-9a8b-44c4-a52e-5eddf78febb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112819) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:43:11.461309 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG oslo_db.sqlalchemy.engines [None req-6ccec6b4-7c4a-4f09-8d4f-652bd880f9c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112818) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:43:11.463427 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG oslo_db.sqlalchemy.engines [None req-6ccec6b4-7c4a-4f09-8d4f-652bd880f9c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112818) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:43:11.467054 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG dbcounter [-] [112819] Writer thread running {{(pid=112819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:43:11.468548 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG dbcounter [-] [112819] Writer thread running {{(pid=112819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:43:11.468962 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG dbcounter [-] [112818] Writer thread running {{(pid=112818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:43:11.471327 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG dbcounter [-] [112818] Writer thread running {{(pid=112818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:43:11.613776 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO dbcounter [None req-6ccec6b4-7c4a-4f09-8d4f-652bd880f9c4 None None] Registered counter for database nova_cell0 Aug 24 03:43:11.614075 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO dbcounter [None req-75fbe75f-9a8b-44c4-a52e-5eddf78febb2 None None] Registered counter for database nova_cell0 Aug 24 03:43:11.623705 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG oslo_db.sqlalchemy.engines [None req-75fbe75f-9a8b-44c4-a52e-5eddf78febb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112819) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:43:11.627139 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG oslo_db.sqlalchemy.engines [None req-6ccec6b4-7c4a-4f09-8d4f-652bd880f9c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112818) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:43:11.628245 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG dbcounter [-] [112819] Writer thread running {{(pid=112819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:43:11.631589 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG dbcounter [-] [112818] Writer thread running {{(pid=112818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:43:12.033419 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: WARNING keystonemiddleware.auth_token [None req-75fbe75f-9a8b-44c4-a52e-5eddf78febb2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:43:12.040656 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: WARNING keystonemiddleware.auth_token [None req-75fbe75f-9a8b-44c4-a52e-5eddf78febb2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:43:12.056978 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: WARNING keystonemiddleware.auth_token [None req-6ccec6b4-7c4a-4f09-8d4f-652bd880f9c4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:43:12.064231 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: WARNING keystonemiddleware.auth_token [None req-6ccec6b4-7c4a-4f09-8d4f-652bd880f9c4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:43:12.382977 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: WARNING keystonemiddleware.auth_token [None req-75fbe75f-9a8b-44c4-a52e-5eddf78febb2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:43:12.389688 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: WARNING keystonemiddleware.auth_token [None req-75fbe75f-9a8b-44c4-a52e-5eddf78febb2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:43:12.394941 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562974f2a9c0 pid: 112819 (default app) Aug 24 03:43:12.397002 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-75fbe75f-9a8b-44c4-a52e-5eddf78febb2 None None] Calling method '>' {{(pid=112819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:12.402451 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO nova.api.openstack.requestlog [None req-75fbe75f-9a8b-44c4-a52e-5eddf78febb2 None None] 10.222.0.82 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001730 Aug 24 03:43:12.402451 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: [pid: 112819|app: 0|req: 1/1] 10.222.0.82 () {50 vars in 788 bytes} [Wed Aug 24 03:43:12 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:43:12.414732 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: WARNING keystonemiddleware.auth_token [None req-6ccec6b4-7c4a-4f09-8d4f-652bd880f9c4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:43:12.420806 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: WARNING keystonemiddleware.auth_token [None req-6ccec6b4-7c4a-4f09-8d4f-652bd880f9c4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:43:12.426098 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562974f2a9c0 pid: 112818 (default app) Aug 24 03:44:36.521010 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-75fbe75f-9a8b-44c4-a52e-5eddf78febb2 None None] Calling method '>' {{(pid=112819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:36.522001 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO nova.api.openstack.requestlog [None req-75fbe75f-9a8b-44c4-a52e-5eddf78febb2 None None] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 24 03:44:36.522402 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: [pid: 112819|app: 0|req: 2/2] 10.222.0.82 () {54 vars in 931 bytes} [Wed Aug 24 03:44:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:44:36.535151 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG dbcounter [-] [112818] Writing DB stats nova_api:SELECT=3 {{(pid=112818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:36.536416 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG dbcounter [-] [112818] Writing DB stats nova_cell1:SELECT=3 {{(pid=112818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:36.537218 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG dbcounter [-] [112818] Writing DB stats nova_cell0:SELECT=3 {{(pid=112818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:36.538080 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG dbcounter [-] [112818] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:37.436991 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi [None req-e8356062-c633-41c6-b222-c309074bb887 admin admin] Calling method '>' {{(pid=112818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:37.468659 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO nova.api.openstack.requestlog [None req-e8356062-c633-41c6-b222-c309074bb887 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.939007 Aug 24 03:44:37.469397 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: [pid: 112818|app: 0|req: 1/3] 10.222.0.82 () {60 vars in 1292 bytes} [Wed Aug 24 03:44:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:39.889704 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-75fbe75f-9a8b-44c4-a52e-5eddf78febb2 None None] Calling method '>' {{(pid=112819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:39.890653 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO nova.api.openstack.requestlog [None req-75fbe75f-9a8b-44c4-a52e-5eddf78febb2 None None] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Aug 24 03:44:39.891214 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: [pid: 112819|app: 0|req: 3/4] 10.222.0.82 () {54 vars in 931 bytes} [Wed Aug 24 03:44:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:44:40.361899 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi [None req-882ae9eb-c736-4f76-864d-32f43f685226 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "name": "cirros256", "disk": 1, "id": "c1", "ram": 256}} {{(pid=112818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:40.382574 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:44:40.382574 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: warnings.warn(msg) Aug 24 03:44:40.499251 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO nova.api.openstack.requestlog [None req-882ae9eb-c736-4f76-864d-32f43f685226 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.601784 Aug 24 03:44:40.502649 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: [pid: 112818|app: 0|req: 2/5] 10.222.0.82 () {64 vars in 1283 bytes} [Wed Aug 24 03:44:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 03:44:40.731835 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-ee09c9fd-da80-4831-9e3a-0aa8b205574f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:40.736073 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:44:40.736073 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: warnings.warn(msg) Aug 24 03:44:40.739164 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG dbcounter [-] [112819] Writing DB stats nova_api:SELECT=3 {{(pid=112819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:40.740033 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG dbcounter [-] [112819] Writing DB stats nova_cell0:SELECT=3 {{(pid=112819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:40.740999 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG dbcounter [-] [112819] Writing DB stats nova_cell1:SELECT=3 {{(pid=112819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:40.741879 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG dbcounter [-] [112819] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:40.910951 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO nova.api.openstack.requestlog [None req-ee09c9fd-da80-4831-9e3a-0aa8b205574f admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.402076 Aug 24 03:44:40.911602 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: [pid: 112819|app: 0|req: 4/6] 10.222.0.82 () {64 vars in 1336 bytes} [Wed Aug 24 03:44:40 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:44:43.330188 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi [None req-882ae9eb-c736-4f76-864d-32f43f685226 admin admin] Calling method '>' {{(pid=112818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:43.331145 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO nova.api.openstack.requestlog [None req-882ae9eb-c736-4f76-864d-32f43f685226 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Aug 24 03:44:43.331542 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: [pid: 112818|app: 0|req: 3/7] 10.222.0.82 () {54 vars in 931 bytes} [Wed Aug 24 03:44:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:44:43.992593 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-4ab5b5d4-9b30-4526-b454-edee2e9c068e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 5, "os-flavor-access:is_public": true, "id": "d1", "name": "ds512M", "vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=112819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:44.012895 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:44:44.012895 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: warnings.warn(msg) Aug 24 03:44:44.138491 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO nova.api.openstack.requestlog [None req-4ab5b5d4-9b30-4526-b454-edee2e9c068e admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.800623 Aug 24 03:44:44.147231 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: [pid: 112819|app: 0|req: 5/8] 10.222.0.82 () {64 vars in 1283 bytes} [Wed Aug 24 03:44:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 03:44:44.151483 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi [None req-992583b0-94b2-4918-b31f-2d5d773e4328 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:44.154397 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:44:44.154397 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: warnings.warn(msg) Aug 24 03:44:44.272977 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO nova.api.openstack.requestlog [None req-992583b0-94b2-4918-b31f-2d5d773e4328 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.125219 Aug 24 03:44:44.273543 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: [pid: 112818|app: 0|req: 4/9] 10.222.0.82 () {64 vars in 1336 bytes} [Wed Aug 24 03:44:44 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:44:46.655146 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-4ab5b5d4-9b30-4526-b454-edee2e9c068e admin admin] Calling method '>' {{(pid=112819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:46.656164 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO nova.api.openstack.requestlog [None req-4ab5b5d4-9b30-4526-b454-edee2e9c068e admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001557 Aug 24 03:44:46.656568 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: [pid: 112819|app: 0|req: 6/10] 10.222.0.82 () {54 vars in 931 bytes} [Wed Aug 24 03:44:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:44:47.064320 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi [None req-8ae25218-bdc5-4932-9672-5fe8be88b89d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 1024, "name": "ds1G", "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=112818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:47.160801 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO nova.api.openstack.requestlog [None req-8ae25218-bdc5-4932-9672-5fe8be88b89d admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.497709 Aug 24 03:44:47.161712 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: [pid: 112818|app: 0|req: 5/11] 10.222.0.82 () {64 vars in 1283 bytes} [Wed Aug 24 03:44:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 03:44:47.173842 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-0eb66c30-8c06-4957-b178-4ad5bb340aad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:47.270365 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO nova.api.openstack.requestlog [None req-0eb66c30-8c06-4957-b178-4ad5bb340aad admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100170 Aug 24 03:44:47.270998 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: [pid: 112819|app: 0|req: 7/12] 10.222.0.82 () {64 vars in 1336 bytes} [Wed Aug 24 03:44:47 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:49.749109 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi [None req-8ae25218-bdc5-4932-9672-5fe8be88b89d admin admin] Calling method '>' {{(pid=112818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:49.750345 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO nova.api.openstack.requestlog [None req-8ae25218-bdc5-4932-9672-5fe8be88b89d admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001665 Aug 24 03:44:49.750890 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: [pid: 112818|app: 0|req: 6/13] 10.222.0.82 () {54 vars in 931 bytes} [Wed Aug 24 03:44:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:44:50.188747 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-d8902cc3-73fc-4aa3-95d6-87d7fbb1d910 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "os-flavor-access:is_public": true, "vcpus": 2, "id": "d3", "name": "ds2G", "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=112819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:50.274860 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO nova.api.openstack.requestlog [None req-d8902cc3-73fc-4aa3-95d6-87d7fbb1d910 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.517533 Aug 24 03:44:50.275478 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: [pid: 112819|app: 0|req: 8/14] 10.222.0.82 () {64 vars in 1283 bytes} [Wed Aug 24 03:44:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:44:50.289908 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi [None req-a8d05e69-9eb6-48d1-b13a-73defd7c4b74 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:50.393833 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO nova.api.openstack.requestlog [None req-a8d05e69-9eb6-48d1-b13a-73defd7c4b74 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107550 Aug 24 03:44:50.394421 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: [pid: 112818|app: 0|req: 7/15] 10.222.0.82 () {64 vars in 1336 bytes} [Wed Aug 24 03:44:50 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:44:52.848336 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-d8902cc3-73fc-4aa3-95d6-87d7fbb1d910 admin admin] Calling method '>' {{(pid=112819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:52.849342 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO nova.api.openstack.requestlog [None req-d8902cc3-73fc-4aa3-95d6-87d7fbb1d910 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 24 03:44:52.849749 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: [pid: 112819|app: 0|req: 9/16] 10.222.0.82 () {54 vars in 931 bytes} [Wed Aug 24 03:44:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:44:53.286935 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi [None req-3a9e6fac-5b4b-4ccd-9f84-bf02c971f270 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "os-flavor-access:is_public": true, "ram": 4096, "vcpus": 4, "id": "d4", "swap": 0, "disk": 20, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:53.386141 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO nova.api.openstack.requestlog [None req-3a9e6fac-5b4b-4ccd-9f84-bf02c971f270 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.530084 Aug 24 03:44:53.386736 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: [pid: 112818|app: 0|req: 8/17] 10.222.0.82 () {64 vars in 1283 bytes} [Wed Aug 24 03:44:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:44:53.399195 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-0e1cadea-4710-44ef-86ba-acc775118903 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:53.534092 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO nova.api.openstack.requestlog [None req-0e1cadea-4710-44ef-86ba-acc775118903 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.138191 Aug 24 03:44:53.535046 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: [pid: 112819|app: 0|req: 10/18] 10.222.0.82 () {64 vars in 1336 bytes} [Wed Aug 24 03:44:53 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:56.583090 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi [None req-3a9e6fac-5b4b-4ccd-9f84-bf02c971f270 admin admin] Calling method '>' {{(pid=112818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:56.586715 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO nova.api.openstack.requestlog [None req-3a9e6fac-5b4b-4ccd-9f84-bf02c971f270 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001971 Aug 24 03:44:56.586715 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: [pid: 112818|app: 0|req: 9/19] 10.222.0.82 () {54 vars in 931 bytes} [Wed Aug 24 03:44:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:44:57.034190 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-d5ab26b3-4898-45a4-8632-5c8ff61ff747 admin admin] Calling method '>' {{(pid=112819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:57.058639 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO nova.api.openstack.requestlog [None req-d5ab26b3-4898-45a4-8632-5c8ff61ff747 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.465231 Aug 24 03:44:57.060971 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: [pid: 112819|app: 0|req: 11/20] 10.222.0.82 () {60 vars in 1292 bytes} [Wed Aug 24 03:44:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:00.114364 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi [None req-3a9e6fac-5b4b-4ccd-9f84-bf02c971f270 admin admin] Calling method '>' {{(pid=112818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:00.115432 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO nova.api.openstack.requestlog [None req-3a9e6fac-5b4b-4ccd-9f84-bf02c971f270 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 Aug 24 03:45:00.115841 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: [pid: 112818|app: 0|req: 10/21] 10.222.0.82 () {54 vars in 931 bytes} [Wed Aug 24 03:45:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:00.513189 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-1519edcf-ea4c-4e0b-8858-b3726c559397 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "1", "ram": 512, "os-flavor-access:is_public": true, "name": "m1.tiny", "disk": 1, "rxtx_factor": 1.0}} {{(pid=112819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:00.593092 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO nova.api.openstack.requestlog [None req-1519edcf-ea4c-4e0b-8858-b3726c559397 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.470974 Aug 24 03:45:00.593576 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: [pid: 112819|app: 0|req: 12/22] 10.222.0.82 () {64 vars in 1283 bytes} [Wed Aug 24 03:45:00 2022] POST /compute/v2.1/flavors => generated 402 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 03:45:00.606890 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi [None req-64b70f83-8ca0-438f-a2e0-0dcb7b6495a3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:00.712625 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO nova.api.openstack.requestlog [None req-64b70f83-8ca0-438f-a2e0-0dcb7b6495a3 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.110184 Aug 24 03:45:00.713201 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: [pid: 112818|app: 0|req: 11/23] 10.222.0.82 () {64 vars in 1333 bytes} [Wed Aug 24 03:45:00 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:03.109692 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-1519edcf-ea4c-4e0b-8858-b3726c559397 admin admin] Calling method '>' {{(pid=112819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:03.110743 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO nova.api.openstack.requestlog [None req-1519edcf-ea4c-4e0b-8858-b3726c559397 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Aug 24 03:45:03.111158 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: [pid: 112819|app: 0|req: 13/24] 10.222.0.82 () {54 vars in 931 bytes} [Wed Aug 24 03:45:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:03.532838 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi [None req-391775e9-b60d-4fff-a49a-12a43dbbbff1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "id": "2", "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "rxtx_factor": 1.0, "swap": 0, "disk": 20}} {{(pid=112818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:03.623584 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO nova.api.openstack.requestlog [None req-391775e9-b60d-4fff-a49a-12a43dbbbff1 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.506249 Aug 24 03:45:03.628457 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: [pid: 112818|app: 0|req: 12/25] 10.222.0.82 () {64 vars in 1283 bytes} [Wed Aug 24 03:45:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:45:03.636002 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-38622456-66b6-4c41-a2c5-390562746119 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:03.752849 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO nova.api.openstack.requestlog [None req-38622456-66b6-4c41-a2c5-390562746119 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120466 Aug 24 03:45:03.753546 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: [pid: 112819|app: 0|req: 14/26] 10.222.0.82 () {64 vars in 1333 bytes} [Wed Aug 24 03:45:03 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:06.190977 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi [None req-391775e9-b60d-4fff-a49a-12a43dbbbff1 admin admin] Calling method '>' {{(pid=112818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:06.222691 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO nova.api.openstack.requestlog [None req-391775e9-b60d-4fff-a49a-12a43dbbbff1 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 24 03:45:06.222691 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: [pid: 112818|app: 0|req: 13/27] 10.222.0.82 () {54 vars in 931 bytes} [Wed Aug 24 03:45:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:45:06.745050 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-4405d1f4-5321-44fd-ab2d-19203fe06949 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "id": "3", "disk": 40, "vcpus": 2, "name": "m1.medium"}} {{(pid=112819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:06.979507 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO nova.api.openstack.requestlog [None req-4405d1f4-5321-44fd-ab2d-19203fe06949 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.781048 Aug 24 03:45:06.980363 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: [pid: 112819|app: 0|req: 15/28] 10.222.0.82 () {64 vars in 1283 bytes} [Wed Aug 24 03:45:06 2022] POST /compute/v2.1/flavors => generated 406 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 03:45:06.995764 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi [None req-f78c5954-ae77-4beb-8771-5451bcb623bc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:07.002365 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG dbcounter [-] [112818] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=112818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:07.105519 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO nova.api.openstack.requestlog [None req-f78c5954-ae77-4beb-8771-5451bcb623bc admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.115866 Aug 24 03:45:07.106689 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: [pid: 112818|app: 0|req: 14/29] 10.222.0.82 () {64 vars in 1333 bytes} [Wed Aug 24 03:45:06 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:09.633579 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-4405d1f4-5321-44fd-ab2d-19203fe06949 admin admin] Calling method '>' {{(pid=112819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:09.634534 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO nova.api.openstack.requestlog [None req-4405d1f4-5321-44fd-ab2d-19203fe06949 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 24 03:45:09.635152 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: [pid: 112819|app: 0|req: 16/30] 10.222.0.82 () {54 vars in 931 bytes} [Wed Aug 24 03:45:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:10.091181 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi [None req-c45e2b73-7547-4de2-9481-ec38b0599e0b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "id": "4", "disk": 80, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.large", "ram": 8192}} {{(pid=112818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:10.170436 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO nova.api.openstack.requestlog [None req-c45e2b73-7547-4de2-9481-ec38b0599e0b admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.527303 Aug 24 03:45:10.171199 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: [pid: 112818|app: 0|req: 15/31] 10.222.0.82 () {64 vars in 1283 bytes} [Wed Aug 24 03:45:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 03:45:10.183184 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-bc65b9d0-dfea-4776-8d0c-51771e1f686c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:10.279643 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO nova.api.openstack.requestlog [None req-bc65b9d0-dfea-4776-8d0c-51771e1f686c admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099946 Aug 24 03:45:10.280548 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: [pid: 112819|app: 0|req: 17/32] 10.222.0.82 () {64 vars in 1333 bytes} [Wed Aug 24 03:45:10 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:12.743512 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi [None req-c45e2b73-7547-4de2-9481-ec38b0599e0b admin admin] Calling method '>' {{(pid=112818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:12.744548 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO nova.api.openstack.requestlog [None req-c45e2b73-7547-4de2-9481-ec38b0599e0b admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 24 03:45:12.745012 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: [pid: 112818|app: 0|req: 16/33] 10.222.0.82 () {54 vars in 931 bytes} [Wed Aug 24 03:45:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:13.213135 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-728f7b94-3618-4b70-a5d5-360a18c8a21b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "disk": 160, "id": "5", "ram": 16384, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge"}} {{(pid=112819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:13.223904 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG dbcounter [-] [112819] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=112819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:13.301853 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO nova.api.openstack.requestlog [None req-728f7b94-3618-4b70-a5d5-360a18c8a21b admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.548813 Aug 24 03:45:13.302649 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: [pid: 112819|app: 0|req: 18/34] 10.222.0.82 () {64 vars in 1283 bytes} [Wed Aug 24 03:45:12 2022] POST /compute/v2.1/flavors => generated 408 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:45:13.318358 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi [None req-e2a33fba-5ad7-4002-9984-7c928c5b2c00 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:13.417236 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO nova.api.openstack.requestlog [None req-e2a33fba-5ad7-4002-9984-7c928c5b2c00 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105488 Aug 24 03:45:13.418717 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: [pid: 112818|app: 0|req: 17/35] 10.222.0.82 () {64 vars in 1333 bytes} [Wed Aug 24 03:45:13 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:32.145603 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-728f7b94-3618-4b70-a5d5-360a18c8a21b admin admin] Calling method '>' {{(pid=112819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:32.146731 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO nova.api.openstack.requestlog [None req-728f7b94-3618-4b70-a5d5-360a18c8a21b admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 24 03:45:32.147217 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: [pid: 112819|app: 0|req: 19/36] 10.222.0.82 () {54 vars in 931 bytes} [Wed Aug 24 03:45:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:32.158422 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG dbcounter [-] [112818] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=112818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:32.553729 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi [None req-7dd3a578-7fd6-4cb3-88cd-7c2d748d8e7f admin admin] Calling method '>' {{(pid=112818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:32.572057 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO nova.api.openstack.requestlog [None req-7dd3a578-7fd6-4cb3-88cd-7c2d748d8e7f admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.418727 Aug 24 03:45:32.572519 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: [pid: 112818|app: 0|req: 18/37] 10.222.0.82 () {60 vars in 1292 bytes} [Wed Aug 24 03:45:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:33.645863 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-728f7b94-3618-4b70-a5d5-360a18c8a21b admin admin] Calling method '>' {{(pid=112819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:33.646848 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO nova.api.openstack.requestlog [None req-728f7b94-3618-4b70-a5d5-360a18c8a21b admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Aug 24 03:45:33.647279 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: [pid: 112819|app: 0|req: 20/38] 10.222.0.82 () {56 vars in 1074 bytes} [Wed Aug 24 03:45:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:34.191004 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi [None req-0fba2e49-51e7-4351-baf8-1e1b8605cb7c admin admin] Calling method '>' {{(pid=112818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:34.196648 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO nova.api.openstack.wsgi [None req-0fba2e49-51e7-4351-baf8-1e1b8605cb7c admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 03:45:34.200172 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi [None req-0fba2e49-51e7-4351-baf8-1e1b8605cb7c admin admin] Request method failure captured: Aug 24 03:45:34.200172 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 03:45:34.200172 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: Accept: application/json Aug 24 03:45:34.200172 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: Accept-Encoding: gzip, deflate Aug 24 03:45:34.200172 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: Connection: keep-alive Aug 24 03:45:34.200172 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: Content-Length: 0 Aug 24 03:45:34.200172 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: Host: 10.222.0.82 Aug 24 03:45:34.200172 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: Openstack-Api-Version: compute 2.90 Aug 24 03:45:34.200172 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: Openstack-System-Scope: None Aug 24 03:45:34.200172 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: User-Agent: python-novaclient Aug 24 03:45:34.200172 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Auth-Token: gAAAAABjBZ7dQva-iY48uJAcOguYSyAzr6EhZJzKbv3RXXQgWnPId7dA9c-Mwmz--PGxAR5bfaIfFa1u0UCN5ArZELN53Lu2-Ihm1sFoN5pAxnxEra9udY7pjxmIyy6yPi53CacKpRmzUKnqkVNmJ11RWs9epypcOkI-JxUII_cO_SIjU4dvfPw Aug 24 03:45:34.200172 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Domain-Id: None Aug 24 03:45:34.200172 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Domain-Name: None Aug 24 03:45:34.200172 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Identity-Status: Confirmed Aug 24 03:45:34.200172 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Is-Admin-Project: True Aug 24 03:45:34.200172 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 03:45:34.200172 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Project-Domain-Id: default Aug 24 03:45:34.200172 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Project-Domain-Name: Default Aug 24 03:45:34.200172 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Project-Id: 0dfb110c668f41649b36f4c725749a3a Aug 24 03:45:34.200172 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Project-Name: admin Aug 24 03:45:34.200172 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Role: admin,member,reader Aug 24 03:45:34.200172 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Roles: admin,member,reader Aug 24 03:45:34.202109 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/0dfb110c668f41649b36f4c725749a3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/0dfb110c668f41649b36f4c725749a3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/0dfb110c668f41649b36f4c725749a3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_0dfb110c668f41649b36f4c725749a3a", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:45:34.202109 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Tenant: admin Aug 24 03:45:34.202109 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Tenant-Id: 0dfb110c668f41649b36f4c725749a3a Aug 24 03:45:34.202109 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Tenant-Name: admin Aug 24 03:45:34.202109 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-User: admin Aug 24 03:45:34.202109 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-User-Domain-Id: default Aug 24 03:45:34.202109 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-User-Domain-Name: Default Aug 24 03:45:34.202109 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-User-Id: c44d1cb246ea41a89355002d9d2481af Aug 24 03:45:34.202109 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-User-Name: admin Aug 24 03:45:34.202109 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: method: > Aug 24 03:45:34.202109 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: exception: Flavor 42 could not be found. Aug 24 03:45:34.202109 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: action_args: {'id': '42'} Aug 24 03:45:34.202109 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: {{(pid=112818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:45:34.202109 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:34.203056 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 03:45:34.203056 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 03:45:34.203056 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 03:45:34.203056 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 03:45:34.203056 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:45:34.203056 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:45:34.203056 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 03:45:34.203056 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 03:45:34.203056 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 03:45:34.203056 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:45:34.203056 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 03:45:34.203056 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 03:45:34.203056 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 03:45:34.203056 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi Aug 24 03:45:34.203056 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:45:34.203056 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi Aug 24 03:45:34.203056 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:34.203056 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:45:34.203056 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:45:34.204468 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:45:34.204468 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:45:34.204468 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:45:34.204468 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:45:34.204468 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 03:45:34.204468 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:45:34.204468 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 03:45:34.204468 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi Aug 24 03:45:34.204468 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:45:34.204468 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi Aug 24 03:45:34.204468 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:34.204468 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:45:34.204468 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:45:34.204468 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:45:34.204468 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:45:34.204468 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 03:45:34.204468 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi Aug 24 03:45:34.204468 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi [None req-0fba2e49-51e7-4351-baf8-1e1b8605cb7c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:45:34.205862 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO nova.api.openstack.requestlog [None req-0fba2e49-51e7-4351-baf8-1e1b8605cb7c admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.409051 Aug 24 03:45:34.205862 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: [pid: 112818|app: 0|req: 19/39] 10.222.0.82 () {60 vars in 1190 bytes} [Wed Aug 24 03:45:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 410 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 03:45:34.211090 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-560fb3bc-340b-4bc8-92f3-95debcd68155 admin admin] Calling method '>' {{(pid=112819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:34.235183 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO nova.api.openstack.requestlog [None req-560fb3bc-340b-4bc8-92f3-95debcd68155 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027120 Aug 24 03:45:34.235963 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: [pid: 112819|app: 0|req: 21/40] 10.222.0.82 () {60 vars in 1210 bytes} [Wed Aug 24 03:45:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:34.246142 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi [None req-c1b41520-f678-4d9e-940c-46e9269213f6 admin admin] Calling method '>' {{(pid=112818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:34.270625 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO nova.api.openstack.requestlog [None req-c1b41520-f678-4d9e-940c-46e9269213f6 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028145 Aug 24 03:45:34.271384 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: [pid: 112818|app: 0|req: 20/41] 10.222.0.82 () {60 vars in 1210 bytes} [Wed Aug 24 03:45:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:34.281152 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-e32fb998-24a1-4098-b56e-b246ae7707d0 admin admin] Calling method '>' {{(pid=112819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:34.287247 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO nova.api.openstack.wsgi [None req-e32fb998-24a1-4098-b56e-b246ae7707d0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 03:45:34.290463 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-e32fb998-24a1-4098-b56e-b246ae7707d0 admin admin] Request method failure captured: Aug 24 03:45:34.290463 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 03:45:34.290463 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: Accept: application/json Aug 24 03:45:34.290463 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: Accept-Encoding: gzip, deflate Aug 24 03:45:34.290463 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: Connection: keep-alive Aug 24 03:45:34.290463 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: Content-Length: 0 Aug 24 03:45:34.290463 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: Host: 10.222.0.82 Aug 24 03:45:34.290463 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: Openstack-Api-Version: compute 2.90 Aug 24 03:45:34.290463 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: Openstack-System-Scope: None Aug 24 03:45:34.290463 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: User-Agent: python-novaclient Aug 24 03:45:34.290463 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Auth-Token: gAAAAABjBZ7dQva-iY48uJAcOguYSyAzr6EhZJzKbv3RXXQgWnPId7dA9c-Mwmz--PGxAR5bfaIfFa1u0UCN5ArZELN53Lu2-Ihm1sFoN5pAxnxEra9udY7pjxmIyy6yPi53CacKpRmzUKnqkVNmJ11RWs9epypcOkI-JxUII_cO_SIjU4dvfPw Aug 24 03:45:34.290463 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Domain-Id: None Aug 24 03:45:34.290463 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Domain-Name: None Aug 24 03:45:34.290463 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Identity-Status: Confirmed Aug 24 03:45:34.290463 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Is-Admin-Project: True Aug 24 03:45:34.290463 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 03:45:34.290463 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Project-Domain-Id: default Aug 24 03:45:34.290463 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Project-Domain-Name: Default Aug 24 03:45:34.290463 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Project-Id: 0dfb110c668f41649b36f4c725749a3a Aug 24 03:45:34.290463 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Project-Name: admin Aug 24 03:45:34.290463 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Role: admin,member,reader Aug 24 03:45:34.290463 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Roles: admin,member,reader Aug 24 03:45:34.292154 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/0dfb110c668f41649b36f4c725749a3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/0dfb110c668f41649b36f4c725749a3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/0dfb110c668f41649b36f4c725749a3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_0dfb110c668f41649b36f4c725749a3a", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:45:34.292154 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Tenant: admin Aug 24 03:45:34.292154 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Tenant-Id: 0dfb110c668f41649b36f4c725749a3a Aug 24 03:45:34.292154 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Tenant-Name: admin Aug 24 03:45:34.292154 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-User: admin Aug 24 03:45:34.292154 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-User-Domain-Id: default Aug 24 03:45:34.292154 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-User-Domain-Name: Default Aug 24 03:45:34.292154 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-User-Id: c44d1cb246ea41a89355002d9d2481af Aug 24 03:45:34.292154 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-User-Name: admin Aug 24 03:45:34.292154 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: method: > Aug 24 03:45:34.292154 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: exception: Flavor 42 could not be found. Aug 24 03:45:34.292154 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: action_args: {'id': '42'} Aug 24 03:45:34.292154 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: {{(pid=112819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:45:34.292154 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:34.293147 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 03:45:34.293147 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 03:45:34.293147 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 03:45:34.293147 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 03:45:34.293147 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:45:34.293147 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:45:34.293147 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 03:45:34.293147 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 03:45:34.293147 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 03:45:34.293147 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:45:34.293147 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 03:45:34.293147 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 03:45:34.293147 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 03:45:34.293147 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi Aug 24 03:45:34.293147 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:45:34.293147 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi Aug 24 03:45:34.293147 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:34.293147 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:45:34.293147 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:45:34.295476 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:45:34.295476 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:45:34.295476 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:45:34.295476 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:45:34.295476 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 03:45:34.295476 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:45:34.295476 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 03:45:34.295476 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi Aug 24 03:45:34.295476 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:45:34.295476 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi Aug 24 03:45:34.295476 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:34.295476 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:45:34.295476 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:45:34.295476 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:45:34.295476 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:45:34.295476 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 03:45:34.295476 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi Aug 24 03:45:34.295476 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-e32fb998-24a1-4098-b56e-b246ae7707d0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:45:34.299835 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO nova.api.openstack.requestlog [None req-e32fb998-24a1-4098-b56e-b246ae7707d0 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014786 Aug 24 03:45:34.299835 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: [pid: 112819|app: 0|req: 22/42] 10.222.0.82 () {60 vars in 1190 bytes} [Wed Aug 24 03:45:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 03:45:35.275082 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi [None req-c1b41520-f678-4d9e-940c-46e9269213f6 admin admin] Calling method '>' {{(pid=112818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:35.276109 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO nova.api.openstack.requestlog [None req-c1b41520-f678-4d9e-940c-46e9269213f6 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 24 03:45:35.276501 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: [pid: 112818|app: 0|req: 21/43] 10.222.0.82 () {56 vars in 1074 bytes} [Wed Aug 24 03:45:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:35.837857 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-4d7d481c-83ee-434d-bf7b-0d089218aa14 admin admin] Calling method '>' {{(pid=112819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:35.844161 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO nova.api.openstack.wsgi [None req-4d7d481c-83ee-434d-bf7b-0d089218aa14 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 03:45:35.845674 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-4d7d481c-83ee-434d-bf7b-0d089218aa14 admin admin] Request method failure captured: Aug 24 03:45:35.845674 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 03:45:35.845674 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: Accept: application/json Aug 24 03:45:35.845674 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: Accept-Encoding: gzip, deflate Aug 24 03:45:35.845674 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: Connection: keep-alive Aug 24 03:45:35.845674 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: Content-Length: 0 Aug 24 03:45:35.845674 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: Host: 10.222.0.82 Aug 24 03:45:35.845674 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: Openstack-Api-Version: compute 2.90 Aug 24 03:45:35.845674 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: Openstack-System-Scope: None Aug 24 03:45:35.845674 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: User-Agent: python-novaclient Aug 24 03:45:35.845674 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Auth-Token: gAAAAABjBZ7fmyTzq78Vw2ujR49uB8ySpBo3_gmimL9B5sJGZyPN_aEAXnGIVpdQkdpQVL1QJj2nVckLkfyWAspjTEGpZJI2xVJV20-tgJryyO35mL9WtG5ZjjoIC-buEu186aMRL22ThggjZqaM3iiJovs3_K2NpnxhS3Zzjd8TQMi6Ec2_jQ8 Aug 24 03:45:35.845674 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Domain-Id: None Aug 24 03:45:35.845674 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Domain-Name: None Aug 24 03:45:35.845674 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Identity-Status: Confirmed Aug 24 03:45:35.845674 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Is-Admin-Project: True Aug 24 03:45:35.845674 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 03:45:35.845674 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Project-Domain-Id: default Aug 24 03:45:35.845674 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Project-Domain-Name: Default Aug 24 03:45:35.845674 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Project-Id: 0dfb110c668f41649b36f4c725749a3a Aug 24 03:45:35.845674 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Project-Name: admin Aug 24 03:45:35.845674 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Role: admin,member,reader Aug 24 03:45:35.845674 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Roles: admin,member,reader Aug 24 03:45:35.847185 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/0dfb110c668f41649b36f4c725749a3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/0dfb110c668f41649b36f4c725749a3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/0dfb110c668f41649b36f4c725749a3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_0dfb110c668f41649b36f4c725749a3a", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:45:35.847185 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Tenant: admin Aug 24 03:45:35.847185 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Tenant-Id: 0dfb110c668f41649b36f4c725749a3a Aug 24 03:45:35.847185 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Tenant-Name: admin Aug 24 03:45:35.847185 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-User: admin Aug 24 03:45:35.847185 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-User-Domain-Id: default Aug 24 03:45:35.847185 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-User-Domain-Name: Default Aug 24 03:45:35.847185 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-User-Id: c44d1cb246ea41a89355002d9d2481af Aug 24 03:45:35.847185 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-User-Name: admin Aug 24 03:45:35.847185 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: method: > Aug 24 03:45:35.847185 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: exception: Flavor 84 could not be found. Aug 24 03:45:35.847185 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: action_args: {'id': '84'} Aug 24 03:45:35.847185 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: {{(pid=112819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:45:35.847185 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:35.848066 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 03:45:35.848066 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 03:45:35.848066 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 03:45:35.848066 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 03:45:35.848066 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:45:35.848066 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:45:35.848066 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 03:45:35.848066 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 03:45:35.848066 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 03:45:35.848066 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:45:35.848066 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 03:45:35.848066 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 03:45:35.848066 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 03:45:35.848066 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi Aug 24 03:45:35.848066 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:45:35.848066 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi Aug 24 03:45:35.848066 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:35.848066 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:45:35.848066 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:45:35.849154 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:45:35.849154 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:45:35.849154 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:45:35.849154 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:45:35.849154 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 03:45:35.849154 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:45:35.849154 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 03:45:35.849154 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi Aug 24 03:45:35.849154 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:45:35.849154 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi Aug 24 03:45:35.849154 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:35.849154 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:45:35.849154 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:45:35.849154 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:45:35.849154 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:45:35.849154 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 03:45:35.849154 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi Aug 24 03:45:35.849154 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-4d7d481c-83ee-434d-bf7b-0d089218aa14 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:45:35.850246 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO nova.api.openstack.requestlog [None req-4d7d481c-83ee-434d-bf7b-0d089218aa14 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.432504 Aug 24 03:45:35.850246 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: [pid: 112819|app: 0|req: 23/44] 10.222.0.82 () {60 vars in 1190 bytes} [Wed Aug 24 03:45:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 434 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 03:45:35.858175 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi [None req-a5d7bc64-45a8-4f74-90af-f79d6493a87f admin admin] Calling method '>' {{(pid=112818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:35.873440 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO nova.api.openstack.requestlog [None req-a5d7bc64-45a8-4f74-90af-f79d6493a87f admin admin] 10.222.0.82 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020120 Aug 24 03:45:35.873970 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: [pid: 112818|app: 0|req: 22/45] 10.222.0.82 () {60 vars in 1210 bytes} [Wed Aug 24 03:45:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:35.883679 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-73671195-371c-4510-8a2c-2ce4601192fe admin admin] Calling method '>' {{(pid=112819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:35.900401 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO nova.api.openstack.requestlog [None req-73671195-371c-4510-8a2c-2ce4601192fe admin admin] 10.222.0.82 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020478 Aug 24 03:45:35.900960 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: [pid: 112819|app: 0|req: 24/46] 10.222.0.82 () {60 vars in 1210 bytes} [Wed Aug 24 03:45:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:35.914376 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi [None req-9498b021-fb37-4b49-baaf-6e7fa8065356 admin admin] Calling method '>' {{(pid=112818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:35.920051 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO nova.api.openstack.wsgi [None req-9498b021-fb37-4b49-baaf-6e7fa8065356 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 03:45:35.921813 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi [None req-9498b021-fb37-4b49-baaf-6e7fa8065356 admin admin] Request method failure captured: Aug 24 03:45:35.921813 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 03:45:35.921813 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: Accept: application/json Aug 24 03:45:35.921813 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: Accept-Encoding: gzip, deflate Aug 24 03:45:35.921813 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: Connection: keep-alive Aug 24 03:45:35.921813 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: Content-Length: 0 Aug 24 03:45:35.921813 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: Host: 10.222.0.82 Aug 24 03:45:35.921813 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: Openstack-Api-Version: compute 2.90 Aug 24 03:45:35.921813 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: Openstack-System-Scope: None Aug 24 03:45:35.921813 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: User-Agent: python-novaclient Aug 24 03:45:35.921813 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Auth-Token: gAAAAABjBZ7fmyTzq78Vw2ujR49uB8ySpBo3_gmimL9B5sJGZyPN_aEAXnGIVpdQkdpQVL1QJj2nVckLkfyWAspjTEGpZJI2xVJV20-tgJryyO35mL9WtG5ZjjoIC-buEu186aMRL22ThggjZqaM3iiJovs3_K2NpnxhS3Zzjd8TQMi6Ec2_jQ8 Aug 24 03:45:35.921813 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Domain-Id: None Aug 24 03:45:35.921813 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Domain-Name: None Aug 24 03:45:35.921813 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Identity-Status: Confirmed Aug 24 03:45:35.921813 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Is-Admin-Project: True Aug 24 03:45:35.921813 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 03:45:35.921813 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Project-Domain-Id: default Aug 24 03:45:35.921813 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Project-Domain-Name: Default Aug 24 03:45:35.921813 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Project-Id: 0dfb110c668f41649b36f4c725749a3a Aug 24 03:45:35.921813 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Project-Name: admin Aug 24 03:45:35.921813 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Role: admin,member,reader Aug 24 03:45:35.921813 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Roles: admin,member,reader Aug 24 03:45:35.924593 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/0dfb110c668f41649b36f4c725749a3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/0dfb110c668f41649b36f4c725749a3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/0dfb110c668f41649b36f4c725749a3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_0dfb110c668f41649b36f4c725749a3a", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:45:35.924593 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Tenant: admin Aug 24 03:45:35.924593 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Tenant-Id: 0dfb110c668f41649b36f4c725749a3a Aug 24 03:45:35.924593 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Tenant-Name: admin Aug 24 03:45:35.924593 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-User: admin Aug 24 03:45:35.924593 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-User-Domain-Id: default Aug 24 03:45:35.924593 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-User-Domain-Name: Default Aug 24 03:45:35.924593 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-User-Id: c44d1cb246ea41a89355002d9d2481af Aug 24 03:45:35.924593 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-User-Name: admin Aug 24 03:45:35.924593 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: method: > Aug 24 03:45:35.924593 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: exception: Flavor 84 could not be found. Aug 24 03:45:35.924593 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: action_args: {'id': '84'} Aug 24 03:45:35.924593 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: {{(pid=112818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:45:35.924593 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:35.925563 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 03:45:35.925563 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 03:45:35.925563 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 03:45:35.925563 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 03:45:35.925563 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:45:35.925563 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:45:35.925563 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 03:45:35.925563 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 03:45:35.925563 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 03:45:35.925563 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:45:35.925563 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 03:45:35.925563 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 03:45:35.925563 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 03:45:35.925563 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi Aug 24 03:45:35.925563 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:45:35.925563 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi Aug 24 03:45:35.925563 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:35.925563 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:45:35.925563 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:45:35.927020 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:45:35.927020 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:45:35.927020 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:45:35.927020 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:45:35.927020 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 03:45:35.927020 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:45:35.927020 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 03:45:35.927020 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi Aug 24 03:45:35.927020 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:45:35.927020 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi Aug 24 03:45:35.927020 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:35.927020 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:45:35.927020 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:45:35.927020 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:45:35.927020 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:45:35.927020 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 03:45:35.927020 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi Aug 24 03:45:35.927020 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi [None req-9498b021-fb37-4b49-baaf-6e7fa8065356 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:45:35.928050 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO nova.api.openstack.requestlog [None req-9498b021-fb37-4b49-baaf-6e7fa8065356 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012477 Aug 24 03:45:35.928050 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: [pid: 112818|app: 0|req: 23/47] 10.222.0.82 () {60 vars in 1190 bytes} [Wed Aug 24 03:45:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 03:45:36.911881 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-73671195-371c-4510-8a2c-2ce4601192fe admin admin] Calling method '>' {{(pid=112819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:36.912963 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO nova.api.openstack.requestlog [None req-73671195-371c-4510-8a2c-2ce4601192fe admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 24 03:45:36.913358 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: [pid: 112819|app: 0|req: 25/48] 10.222.0.82 () {56 vars in 1074 bytes} [Wed Aug 24 03:45:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:37.434993 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi [None req-42a5c457-87b5-4417-8064-78a63706a9bb admin admin] Calling method '>' {{(pid=112818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:37.440722 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO nova.api.openstack.wsgi [None req-42a5c457-87b5-4417-8064-78a63706a9bb admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 03:45:37.442543 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi [None req-42a5c457-87b5-4417-8064-78a63706a9bb admin admin] Request method failure captured: Aug 24 03:45:37.442543 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 03:45:37.442543 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: Accept: application/json Aug 24 03:45:37.442543 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: Accept-Encoding: gzip, deflate Aug 24 03:45:37.442543 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: Connection: keep-alive Aug 24 03:45:37.442543 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: Content-Length: 0 Aug 24 03:45:37.442543 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: Host: 10.222.0.82 Aug 24 03:45:37.442543 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: Openstack-Api-Version: compute 2.90 Aug 24 03:45:37.442543 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: Openstack-System-Scope: None Aug 24 03:45:37.442543 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: User-Agent: python-novaclient Aug 24 03:45:37.442543 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Auth-Token: gAAAAABjBZ7gazUGpwnrHEes827tZWmHB_188SAiX5iTVTa8uh57jYpVvVxyiXL3PcR5xKwususjci9j5FNxLL6U6QebxXsvzG2dXvoKpycieittpXJsc9C9N20kOLe94K-BLK_VyCPuQpnt9xZGcOv6GOCotauj2P3Ak71viUvZHZka3cWMaBE Aug 24 03:45:37.442543 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Domain-Id: None Aug 24 03:45:37.442543 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Domain-Name: None Aug 24 03:45:37.442543 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Identity-Status: Confirmed Aug 24 03:45:37.442543 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Is-Admin-Project: True Aug 24 03:45:37.442543 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 03:45:37.442543 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Project-Domain-Id: default Aug 24 03:45:37.442543 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Project-Domain-Name: Default Aug 24 03:45:37.442543 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Project-Id: 0dfb110c668f41649b36f4c725749a3a Aug 24 03:45:37.442543 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Project-Name: admin Aug 24 03:45:37.442543 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Role: admin,member,reader Aug 24 03:45:37.442543 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Roles: admin,member,reader Aug 24 03:45:37.444089 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/0dfb110c668f41649b36f4c725749a3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/0dfb110c668f41649b36f4c725749a3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/0dfb110c668f41649b36f4c725749a3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_0dfb110c668f41649b36f4c725749a3a", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:45:37.444089 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Tenant: admin Aug 24 03:45:37.444089 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Tenant-Id: 0dfb110c668f41649b36f4c725749a3a Aug 24 03:45:37.444089 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-Tenant-Name: admin Aug 24 03:45:37.444089 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-User: admin Aug 24 03:45:37.444089 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-User-Domain-Id: default Aug 24 03:45:37.444089 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-User-Domain-Name: Default Aug 24 03:45:37.444089 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-User-Id: c44d1cb246ea41a89355002d9d2481af Aug 24 03:45:37.444089 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: X-User-Name: admin Aug 24 03:45:37.444089 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: method: > Aug 24 03:45:37.444089 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: exception: Flavor 451 could not be found. Aug 24 03:45:37.444089 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: action_args: {'id': '451'} Aug 24 03:45:37.444089 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: {{(pid=112818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:45:37.444089 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:37.445068 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 03:45:37.445068 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 03:45:37.445068 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 03:45:37.445068 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 03:45:37.445068 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:45:37.445068 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:45:37.445068 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 03:45:37.445068 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 03:45:37.445068 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 03:45:37.445068 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:45:37.445068 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 03:45:37.445068 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 03:45:37.445068 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 03:45:37.445068 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi Aug 24 03:45:37.445068 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:45:37.445068 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi Aug 24 03:45:37.445068 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:37.445068 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:45:37.445068 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:45:37.446356 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:45:37.446356 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:45:37.446356 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:45:37.446356 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:45:37.446356 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 03:45:37.446356 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:45:37.446356 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 03:45:37.446356 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi Aug 24 03:45:37.446356 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:45:37.446356 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi Aug 24 03:45:37.446356 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:37.446356 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:45:37.446356 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:45:37.446356 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:45:37.446356 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:45:37.446356 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 03:45:37.446356 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: ERROR nova.api.openstack.wsgi Aug 24 03:45:37.446356 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi [None req-42a5c457-87b5-4417-8064-78a63706a9bb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:45:37.447639 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO nova.api.openstack.requestlog [None req-42a5c457-87b5-4417-8064-78a63706a9bb admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.393211 Aug 24 03:45:37.447639 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: [pid: 112818|app: 0|req: 24/49] 10.222.0.82 () {60 vars in 1193 bytes} [Wed Aug 24 03:45:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 03:45:37.454140 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-f04dc98f-c0c3-46e2-a7f4-f33c9406ee90 admin admin] Calling method '>' {{(pid=112819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:37.469479 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO nova.api.openstack.requestlog [None req-f04dc98f-c0c3-46e2-a7f4-f33c9406ee90 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019526 Aug 24 03:45:37.470016 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: [pid: 112819|app: 0|req: 26/50] 10.222.0.82 () {60 vars in 1210 bytes} [Wed Aug 24 03:45:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:37.479514 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi [None req-6d529337-ec3b-4ea0-997f-7ab626589a51 admin admin] Calling method '>' {{(pid=112818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:37.494770 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO nova.api.openstack.requestlog [None req-6d529337-ec3b-4ea0-997f-7ab626589a51 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018776 Aug 24 03:45:37.495300 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: [pid: 112818|app: 0|req: 25/51] 10.222.0.82 () {60 vars in 1210 bytes} [Wed Aug 24 03:45:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:37.504492 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-e2b1fbcd-a8d5-4005-9ba1-2a6a2bd0b5d5 admin admin] Calling method '>' {{(pid=112819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:37.509825 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO nova.api.openstack.wsgi [None req-e2b1fbcd-a8d5-4005-9ba1-2a6a2bd0b5d5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 03:45:37.511362 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-e2b1fbcd-a8d5-4005-9ba1-2a6a2bd0b5d5 admin admin] Request method failure captured: Aug 24 03:45:37.511362 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 03:45:37.511362 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: Accept: application/json Aug 24 03:45:37.511362 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: Accept-Encoding: gzip, deflate Aug 24 03:45:37.511362 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: Connection: keep-alive Aug 24 03:45:37.511362 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: Content-Length: 0 Aug 24 03:45:37.511362 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: Host: 10.222.0.82 Aug 24 03:45:37.511362 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: Openstack-Api-Version: compute 2.90 Aug 24 03:45:37.511362 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: Openstack-System-Scope: None Aug 24 03:45:37.511362 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: User-Agent: python-novaclient Aug 24 03:45:37.511362 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Auth-Token: gAAAAABjBZ7gazUGpwnrHEes827tZWmHB_188SAiX5iTVTa8uh57jYpVvVxyiXL3PcR5xKwususjci9j5FNxLL6U6QebxXsvzG2dXvoKpycieittpXJsc9C9N20kOLe94K-BLK_VyCPuQpnt9xZGcOv6GOCotauj2P3Ak71viUvZHZka3cWMaBE Aug 24 03:45:37.511362 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Domain-Id: None Aug 24 03:45:37.511362 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Domain-Name: None Aug 24 03:45:37.511362 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Identity-Status: Confirmed Aug 24 03:45:37.511362 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Is-Admin-Project: True Aug 24 03:45:37.511362 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 03:45:37.511362 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Project-Domain-Id: default Aug 24 03:45:37.511362 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Project-Domain-Name: Default Aug 24 03:45:37.511362 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Project-Id: 0dfb110c668f41649b36f4c725749a3a Aug 24 03:45:37.511362 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Project-Name: admin Aug 24 03:45:37.511362 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Role: admin,member,reader Aug 24 03:45:37.511362 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Roles: admin,member,reader Aug 24 03:45:37.513046 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/0dfb110c668f41649b36f4c725749a3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/0dfb110c668f41649b36f4c725749a3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/0dfb110c668f41649b36f4c725749a3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_0dfb110c668f41649b36f4c725749a3a", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:45:37.513046 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Tenant: admin Aug 24 03:45:37.513046 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Tenant-Id: 0dfb110c668f41649b36f4c725749a3a Aug 24 03:45:37.513046 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-Tenant-Name: admin Aug 24 03:45:37.513046 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-User: admin Aug 24 03:45:37.513046 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-User-Domain-Id: default Aug 24 03:45:37.513046 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-User-Domain-Name: Default Aug 24 03:45:37.513046 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-User-Id: c44d1cb246ea41a89355002d9d2481af Aug 24 03:45:37.513046 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: X-User-Name: admin Aug 24 03:45:37.513046 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: method: > Aug 24 03:45:37.513046 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: exception: Flavor 451 could not be found. Aug 24 03:45:37.513046 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: action_args: {'id': '451'} Aug 24 03:45:37.513046 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: {{(pid=112819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:45:37.513046 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:37.513985 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 03:45:37.513985 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 03:45:37.513985 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 03:45:37.513985 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 03:45:37.513985 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:45:37.513985 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:45:37.513985 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 03:45:37.513985 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 03:45:37.513985 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 03:45:37.513985 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:45:37.513985 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 03:45:37.513985 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 03:45:37.513985 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 03:45:37.513985 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi Aug 24 03:45:37.513985 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:45:37.513985 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi Aug 24 03:45:37.513985 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:37.513985 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:45:37.513985 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:45:37.515394 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:45:37.515394 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:45:37.515394 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:45:37.515394 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:45:37.515394 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 03:45:37.515394 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:45:37.515394 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 03:45:37.515394 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi Aug 24 03:45:37.515394 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:45:37.515394 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi Aug 24 03:45:37.515394 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:37.515394 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:45:37.515394 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:45:37.515394 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:45:37.515394 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:45:37.515394 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 03:45:37.515394 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: ERROR nova.api.openstack.wsgi Aug 24 03:45:37.515394 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-e2b1fbcd-a8d5-4005-9ba1-2a6a2bd0b5d5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:45:37.516773 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO nova.api.openstack.requestlog [None req-e2b1fbcd-a8d5-4005-9ba1-2a6a2bd0b5d5 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011779 Aug 24 03:45:37.516773 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: [pid: 112819|app: 0|req: 27/52] 10.222.0.82 () {60 vars in 1193 bytes} [Wed Aug 24 03:45:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 24 03:45:38.555470 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi [None req-6d529337-ec3b-4ea0-997f-7ab626589a51 admin admin] Calling method '>' {{(pid=112818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:38.556483 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO nova.api.openstack.requestlog [None req-6d529337-ec3b-4ea0-997f-7ab626589a51 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 24 03:45:38.556877 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: [pid: 112818|app: 0|req: 26/53] 10.222.0.82 () {56 vars in 1074 bytes} [Wed Aug 24 03:45:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:39.118977 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-453d5eed-af25-4587-9eb6-6f9bf3113ff5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:39.204522 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO nova.api.openstack.requestlog [None req-453d5eed-af25-4587-9eb6-6f9bf3113ff5 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.507280 Aug 24 03:45:39.205096 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: [pid: 112819|app: 0|req: 28/54] 10.222.0.82 () {64 vars in 1235 bytes} [Wed Aug 24 03:45:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:45:40.184279 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi [None req-6d529337-ec3b-4ea0-997f-7ab626589a51 admin admin] Calling method '>' {{(pid=112818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:40.185434 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO nova.api.openstack.requestlog [None req-6d529337-ec3b-4ea0-997f-7ab626589a51 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001616 Aug 24 03:45:40.185826 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: [pid: 112818|app: 0|req: 27/55] 10.222.0.82 () {56 vars in 1074 bytes} [Wed Aug 24 03:45:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:45:40.714273 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-ca3898c0-7298-4983-95a3-115658d5ba91 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:40.799592 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO nova.api.openstack.requestlog [None req-ca3898c0-7298-4983-95a3-115658d5ba91 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.471450 Aug 24 03:45:40.800148 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: [pid: 112819|app: 0|req: 29/56] 10.222.0.82 () {64 vars in 1235 bytes} [Wed Aug 24 03:45:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:45:41.817704 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi [None req-6d529337-ec3b-4ea0-997f-7ab626589a51 admin admin] Calling method '>' {{(pid=112818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:41.818738 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO nova.api.openstack.requestlog [None req-6d529337-ec3b-4ea0-997f-7ab626589a51 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Aug 24 03:45:41.819131 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: [pid: 112818|app: 0|req: 28/57] 10.222.0.82 () {56 vars in 1074 bytes} [Wed Aug 24 03:45:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:42.352382 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-25c1e338-674f-48d3-9b6b-66670ea6b2c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:42.456435 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO nova.api.openstack.requestlog [None req-25c1e338-674f-48d3-9b6b-66670ea6b2c0 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.496203 Aug 24 03:45:42.456974 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: [pid: 112819|app: 0|req: 30/58] 10.222.0.82 () {64 vars in 1235 bytes} [Wed Aug 24 03:45:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:45:43.437139 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi [None req-6d529337-ec3b-4ea0-997f-7ab626589a51 admin admin] Calling method '>' {{(pid=112818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:43.438137 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO nova.api.openstack.requestlog [None req-6d529337-ec3b-4ea0-997f-7ab626589a51 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Aug 24 03:45:43.438554 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: [pid: 112818|app: 0|req: 29/59] 10.222.0.82 () {56 vars in 1074 bytes} [Wed Aug 24 03:45:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:43.972306 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-33cd77f3-73e9-43b9-967b-f45d6b7e85e1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:44.056176 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO nova.api.openstack.requestlog [None req-33cd77f3-73e9-43b9-967b-f45d6b7e85e1 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.474209 Aug 24 03:45:44.056738 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: [pid: 112819|app: 0|req: 31/60] 10.222.0.82 () {64 vars in 1235 bytes} [Wed Aug 24 03:45:43 2022] POST /compute/v2.1/flavors => generated 409 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 03:45:45.057973 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi [None req-6d529337-ec3b-4ea0-997f-7ab626589a51 admin admin] Calling method '>' {{(pid=112818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:45.060053 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO nova.api.openstack.requestlog [None req-6d529337-ec3b-4ea0-997f-7ab626589a51 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002560 Aug 24 03:45:45.060513 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: [pid: 112818|app: 0|req: 30/61] 10.222.0.82 () {56 vars in 1074 bytes} [Wed Aug 24 03:45:45 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:45.585607 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-9e19c404-b851-4cc0-9591-c19165e3e053 admin admin] Calling method '>' {{(pid=112819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:45.606062 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO nova.api.openstack.requestlog [None req-9e19c404-b851-4cc0-9591-c19165e3e053 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.406237 Aug 24 03:45:45.606884 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: [pid: 112819|app: 0|req: 32/62] 10.222.0.82 () {60 vars in 1202 bytes} [Wed Aug 24 03:45:45 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:46:40.355332 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi [None req-6d529337-ec3b-4ea0-997f-7ab626589a51 admin admin] Calling method '>' {{(pid=112818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:40.356350 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO nova.api.openstack.requestlog [None req-6d529337-ec3b-4ea0-997f-7ab626589a51 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Aug 24 03:46:40.356749 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: [pid: 112818|app: 0|req: 31/63] 10.222.0.82 () {54 vars in 931 bytes} [Wed Aug 24 03:46:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:40.367688 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG dbcounter [-] [112819] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=112819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:40.800237 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-3c6cfaa4-abef-415c-87e8-5ffecf243e2d admin admin] Calling method '>' {{(pid=112819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:40.820556 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO nova.api.openstack.requestlog [None req-3c6cfaa4-abef-415c-87e8-5ffecf243e2d admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.457357 Aug 24 03:46:40.821104 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: [pid: 112819|app: 0|req: 33/64] 10.222.0.82 () {60 vars in 1292 bytes} [Wed Aug 24 03:46:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:46:40.846438 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi [None req-c3d784d7-15d0-437c-b328-c7e411b87a90 admin admin] Calling method '>' {{(pid=112818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:40.850487 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG dbcounter [-] [112818] Writing DB stats nova_api:SELECT=14 {{(pid=112818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:40.855847 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO nova.api.openstack.requestlog [None req-c3d784d7-15d0-437c-b328-c7e411b87a90 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014925 Aug 24 03:46:40.856532 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: [pid: 112818|app: 0|req: 32/65] 10.222.0.82 () {60 vars in 1283 bytes} [Wed Aug 24 03:46:40 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:40.868451 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-04d73d62-749b-4646-a32f-129d35ac73fc admin admin] Calling method '>' {{(pid=112819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:40.876642 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO nova.api.openstack.requestlog [None req-04d73d62-749b-4646-a32f-129d35ac73fc admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011775 Aug 24 03:46:40.877180 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: [pid: 112819|app: 0|req: 34/66] 10.222.0.82 () {60 vars in 1286 bytes} [Wed Aug 24 03:46:40 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:40.890455 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi [None req-33018c36-9576-4137-b0bb-53d50c868483 admin admin] Calling method '>' {{(pid=112818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:40.899089 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO nova.api.openstack.requestlog [None req-33018c36-9576-4137-b0bb-53d50c868483 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013744 Aug 24 03:46:40.904363 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: [pid: 112818|app: 0|req: 33/67] 10.222.0.82 () {60 vars in 1286 bytes} [Wed Aug 24 03:46:40 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:40.911895 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-41c1a839-9451-4b77-868d-8a413b072204 admin admin] Calling method '>' {{(pid=112819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:40.920056 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO nova.api.openstack.requestlog [None req-41c1a839-9451-4b77-868d-8a413b072204 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011684 Aug 24 03:46:40.920569 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: [pid: 112819|app: 0|req: 35/68] 10.222.0.82 () {60 vars in 1283 bytes} [Wed Aug 24 03:46:40 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:50:02.479302 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi [None req-33018c36-9576-4137-b0bb-53d50c868483 admin admin] Calling method '>' {{(pid=112818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:02.480344 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO nova.api.openstack.requestlog [None req-33018c36-9576-4137-b0bb-53d50c868483 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Aug 24 03:50:02.480765 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: [pid: 112818|app: 0|req: 34/69] 10.222.0.82 () {56 vars in 1074 bytes} [Wed Aug 24 03:50:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:50:02.623746 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG dbcounter [-] [112819] Writing DB stats nova_api:SELECT=6 {{(pid=112819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:02.790090 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-ed689fa8-7684-4ecf-9253-97b2cc8606e8 admin admin] Calling method '>' {{(pid=112819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:02.792461 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:50:02.792461 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: warnings.warn(msg) Aug 24 03:50:02.793603 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG oslo_concurrency.lockutils [None req-ed689fa8-7684-4ecf-9253-97b2cc8606e8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:02.794107 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG oslo_concurrency.lockutils [None req-ed689fa8-7684-4ecf-9253-97b2cc8606e8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:02.794558 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG oslo_concurrency.lockutils [None req-ed689fa8-7684-4ecf-9253-97b2cc8606e8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:02.795276 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG oslo_concurrency.lockutils [None req-ed689fa8-7684-4ecf-9253-97b2cc8606e8 admin admin] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:02.795722 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG oslo_concurrency.lockutils [None req-ed689fa8-7684-4ecf-9253-97b2cc8606e8 admin admin] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:02.796141 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG oslo_concurrency.lockutils [None req-ed689fa8-7684-4ecf-9253-97b2cc8606e8 admin admin] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:02.829484 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO nova.api.openstack.requestlog [None req-ed689fa8-7684-4ecf-9253-97b2cc8606e8 admin admin] 10.222.0.82 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.207211 Aug 24 03:50:02.830061 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: [pid: 112819|app: 0|req: 36/70] 10.222.0.82 () {60 vars in 1193 bytes} [Wed Aug 24 03:50:02 2022] GET /compute/v2.1/os-services => generated 791 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 03:50:03.685410 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi [None req-33018c36-9576-4137-b0bb-53d50c868483 admin admin] Calling method '>' {{(pid=112818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:03.686413 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO nova.api.openstack.requestlog [None req-33018c36-9576-4137-b0bb-53d50c868483 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Aug 24 03:50:03.686837 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: [pid: 112818|app: 0|req: 35/71] 10.222.0.82 () {56 vars in 1074 bytes} [Wed Aug 24 03:50:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:50:03.880897 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-a8e74156-50c2-4d6d-9e3e-27a8a437b412 admin admin] Calling method '>' {{(pid=112819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:03.883091 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:50:03.883091 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: warnings.warn(msg) Aug 24 03:50:03.884196 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG oslo_concurrency.lockutils [None req-a8e74156-50c2-4d6d-9e3e-27a8a437b412 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:03.884676 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG oslo_concurrency.lockutils [None req-a8e74156-50c2-4d6d-9e3e-27a8a437b412 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:03.885111 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG oslo_concurrency.lockutils [None req-a8e74156-50c2-4d6d-9e3e-27a8a437b412 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:03.885831 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG oslo_concurrency.lockutils [None req-a8e74156-50c2-4d6d-9e3e-27a8a437b412 admin admin] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:03.886281 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG oslo_concurrency.lockutils [None req-a8e74156-50c2-4d6d-9e3e-27a8a437b412 admin admin] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:03.886730 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG oslo_concurrency.lockutils [None req-a8e74156-50c2-4d6d-9e3e-27a8a437b412 admin admin] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:03.907070 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO nova.api.openstack.requestlog [None req-a8e74156-50c2-4d6d-9e3e-27a8a437b412 admin admin] 10.222.0.82 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.081318 Aug 24 03:50:03.907630 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: [pid: 112819|app: 0|req: 37/72] 10.222.0.82 () {60 vars in 1193 bytes} [Wed Aug 24 03:50:03 2022] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:50:15.161982 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi [None req-33018c36-9576-4137-b0bb-53d50c868483 admin admin] Calling method '>' {{(pid=112818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:15.163019 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO nova.api.openstack.requestlog [None req-33018c36-9576-4137-b0bb-53d50c868483 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002147 Aug 24 03:50:15.163409 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: [pid: 112818|app: 0|req: 36/73] 10.222.0.82 () {56 vars in 1074 bytes} [Wed Aug 24 03:50:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:50:15.325000 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG dbcounter [-] [112819] Writing DB stats nova_cell0:SELECT=4 {{(pid=112819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:15.325983 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG dbcounter [-] [112819] Writing DB stats nova_cell1:SELECT=4 {{(pid=112819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:15.326240 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG dbcounter [-] [112819] Writing DB stats nova_api:SELECT=8 {{(pid=112819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:15.374869 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-51883487-e916-4299-87a8-1aff75d64c9e admin admin] Calling method '>' {{(pid=112819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:15.377219 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:50:15.377219 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: warnings.warn(msg) Aug 24 03:50:15.378316 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG oslo_concurrency.lockutils [None req-51883487-e916-4299-87a8-1aff75d64c9e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:15.378817 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG oslo_concurrency.lockutils [None req-51883487-e916-4299-87a8-1aff75d64c9e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:15.379254 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG oslo_concurrency.lockutils [None req-51883487-e916-4299-87a8-1aff75d64c9e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:15.380179 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG oslo_concurrency.lockutils [None req-51883487-e916-4299-87a8-1aff75d64c9e admin admin] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:15.380626 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG oslo_concurrency.lockutils [None req-51883487-e916-4299-87a8-1aff75d64c9e admin admin] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:15.381041 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG oslo_concurrency.lockutils [None req-51883487-e916-4299-87a8-1aff75d64c9e admin admin] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:15.405942 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO nova.api.openstack.requestlog [None req-51883487-e916-4299-87a8-1aff75d64c9e admin admin] 10.222.0.82 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.085603 Aug 24 03:50:15.406527 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: [pid: 112819|app: 0|req: 38/74] 10.222.0.82 () {60 vars in 1193 bytes} [Wed Aug 24 03:50:15 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:50:16.237506 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: DEBUG nova.api.openstack.wsgi [None req-33018c36-9576-4137-b0bb-53d50c868483 admin admin] Calling method '>' {{(pid=112818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:16.238538 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: INFO nova.api.openstack.requestlog [None req-33018c36-9576-4137-b0bb-53d50c868483 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Aug 24 03:50:16.239024 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: [pid: 112818|app: 0|req: 37/75] 10.222.0.82 () {56 vars in 1074 bytes} [Wed Aug 24 03:50:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:50:16.434111 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG nova.api.openstack.wsgi [None req-acab86be-d507-4873-9811-74307abddb0a admin admin] Calling method '>' {{(pid=112819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:16.436531 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:50:16.436531 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: warnings.warn(msg) Aug 24 03:50:16.437661 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG oslo_concurrency.lockutils [None req-acab86be-d507-4873-9811-74307abddb0a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:16.438136 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG oslo_concurrency.lockutils [None req-acab86be-d507-4873-9811-74307abddb0a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:16.438617 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG oslo_concurrency.lockutils [None req-acab86be-d507-4873-9811-74307abddb0a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:16.439335 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG oslo_concurrency.lockutils [None req-acab86be-d507-4873-9811-74307abddb0a admin admin] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:16.439779 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG oslo_concurrency.lockutils [None req-acab86be-d507-4873-9811-74307abddb0a admin admin] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:16.440194 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: DEBUG oslo_concurrency.lockutils [None req-acab86be-d507-4873-9811-74307abddb0a admin admin] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:16.462364 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: INFO nova.api.openstack.requestlog [None req-acab86be-d507-4873-9811-74307abddb0a admin admin] 10.222.0.82 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.081837 Aug 24 03:50:16.462963 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: [pid: 112819|app: 0|req: 39/76] 10.222.0.82 () {60 vars in 1193 bytes} [Wed Aug 24 03:50:16 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:15.161962 dv-cinder-854260-1-iscsi devstack@n-api.service[112817]: Wed Aug 24 03:51:15 2022 - graceful shutdown triggered... Aug 24 03:51:15.162462 dv-cinder-854260-1-iscsi devstack@n-api.service[112819]: Gracefully killing worker 2 (pid: 112819)... Aug 24 03:51:15.162087 dv-cinder-854260-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 03:51:15.163302 dv-cinder-854260-1-iscsi devstack@n-api.service[112818]: Gracefully killing worker 1 (pid: 112818)... Aug 24 03:51:16.163111 dv-cinder-854260-1-iscsi devstack@n-api.service[112817]: worker 1 buried after 1 seconds Aug 24 03:51:16.163641 dv-cinder-854260-1-iscsi devstack@n-api.service[112817]: worker 2 buried after 1 seconds Aug 24 03:51:16.163641 dv-cinder-854260-1-iscsi devstack@n-api.service[112817]: goodbye to uWSGI. Aug 24 03:51:16.164778 dv-cinder-854260-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 24 03:51:16.165334 dv-cinder-854260-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 03:51:16.168713 dv-cinder-854260-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 03:51:16.180149 dv-cinder-854260-1-iscsi devstack@n-api.service[127852]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 03:51:16.182183 dv-cinder-854260-1-iscsi devstack@n-api.service[127852]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 03:51:16 2022] *** Aug 24 03:51:16.182183 dv-cinder-854260-1-iscsi devstack@n-api.service[127852]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 03:51:16.182183 dv-cinder-854260-1-iscsi devstack@n-api.service[127852]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 03:51:16.182183 dv-cinder-854260-1-iscsi devstack@n-api.service[127852]: nodename: dv-cinder-854260-1-iscsi Aug 24 03:51:16.182183 dv-cinder-854260-1-iscsi devstack@n-api.service[127852]: machine: x86_64 Aug 24 03:51:16.182183 dv-cinder-854260-1-iscsi devstack@n-api.service[127852]: clock source: unix Aug 24 03:51:16.182183 dv-cinder-854260-1-iscsi devstack@n-api.service[127852]: pcre jit disabled Aug 24 03:51:16.182183 dv-cinder-854260-1-iscsi devstack@n-api.service[127852]: detected number of CPU cores: 4 Aug 24 03:51:16.182183 dv-cinder-854260-1-iscsi devstack@n-api.service[127852]: current working directory: / Aug 24 03:51:16.182183 dv-cinder-854260-1-iscsi devstack@n-api.service[127852]: detected binary path: /usr/bin/uwsgi-core Aug 24 03:51:16.183388 dv-cinder-854260-1-iscsi devstack@n-api.service[127852]: your processes number limit is 47680 Aug 24 03:51:16.183388 dv-cinder-854260-1-iscsi devstack@n-api.service[127852]: your memory page size is 4096 bytes Aug 24 03:51:16.183388 dv-cinder-854260-1-iscsi devstack@n-api.service[127852]: detected max file descriptor number: 2048 Aug 24 03:51:16.183388 dv-cinder-854260-1-iscsi devstack@n-api.service[127852]: lock engine: pthread robust mutexes Aug 24 03:51:16.183388 dv-cinder-854260-1-iscsi devstack@n-api.service[127852]: thunder lock: enabled Aug 24 03:51:16.183388 dv-cinder-854260-1-iscsi devstack@n-api.service[127852]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 03:51:16.183388 dv-cinder-854260-1-iscsi devstack@n-api.service[127852]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 03:51:16.223224 dv-cinder-854260-1-iscsi devstack@n-api.service[127852]: Python main interpreter initialized at 0x563a8ae179c0 Aug 24 03:51:16.223224 dv-cinder-854260-1-iscsi devstack@n-api.service[127852]: python threads support enabled Aug 24 03:51:16.223224 dv-cinder-854260-1-iscsi devstack@n-api.service[127852]: your server socket listen backlog is limited to 100 connections Aug 24 03:51:16.223224 dv-cinder-854260-1-iscsi devstack@n-api.service[127852]: your mercy for graceful operations on workers is 90 seconds Aug 24 03:51:16.223688 dv-cinder-854260-1-iscsi devstack@n-api.service[127852]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 03:51:16.223688 dv-cinder-854260-1-iscsi devstack@n-api.service[127852]: *** Operational MODE: preforking *** Aug 24 03:51:16.223957 dv-cinder-854260-1-iscsi devstack@n-api.service[127852]: *** uWSGI is running in multiple interpreter mode *** Aug 24 03:51:16.223957 dv-cinder-854260-1-iscsi devstack@n-api.service[127852]: spawned uWSGI master process (pid: 127852) Aug 24 03:51:16.224162 dv-cinder-854260-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 03:51:16.224945 dv-cinder-854260-1-iscsi devstack@n-api.service[127852]: spawned uWSGI worker 1 (pid: 127869, cores: 1) Aug 24 03:51:16.226620 dv-cinder-854260-1-iscsi devstack@n-api.service[127852]: spawned uWSGI worker 2 (pid: 127870, cores: 1) Aug 24 03:51:16.226620 dv-cinder-854260-1-iscsi devstack@n-api.service[127852]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 03:51:16.892295 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 03:51:16.907791 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 03:51:18.058735 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:51:18.058735 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: from cryptography.utils import int_from_bytes Aug 24 03:51:18.059166 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:51:18.059166 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: from cryptography.utils import int_from_bytes Aug 24 03:51:18.126320 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:51:18.126320 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: from cryptography.utils import int_from_bytes Aug 24 03:51:18.126908 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:51:18.126908 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: from cryptography.utils import int_from_bytes Aug 24 03:51:20.512577 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 03:51:20.514198 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 03:51:20.514198 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 03:51:20.514198 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 03:51:20.514198 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 03:51:20.514495 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.514873 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.514970 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.515311 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.515816 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.516137 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.516464 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.516789 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.517122 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.517389 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.517709 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.518038 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854260-1-iscsi {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.518364 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.518705 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.519022 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.519345 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.519653 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.519979 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.520288 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.520805 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.521239 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.521548 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.521863 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.522205 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.522536 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.522858 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.523181 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.523492 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.523820 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.524131 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.524541 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854260-1-iscsi {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.524894 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.525734 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.525734 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.525944 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.526265 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.526594 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.526921 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.527247 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.527561 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.527892 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.528214 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.528537 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.528861 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.529172 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.529483 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.529793 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.530115 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.530423 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.530755 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.531011 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.531329 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.531649 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.531971 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.532298 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.532553 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.532806 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.533127 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.533452 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.533765 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.534077 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.534384 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.534722 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.535030 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.535337 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.535647 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.535954 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.536281 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.536844 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.537181 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.537546 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.538001 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.538309 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.82 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.543018 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.82 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.543018 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.543018 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.543018 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.543018 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.543018 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.543018 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.543018 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.544326 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.544326 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.544326 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.544326 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.544326 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.544326 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.544326 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.544326 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.545552 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.545552 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.545552 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.545552 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.545552 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.545552 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.545552 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.546614 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.546614 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.546614 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.547061 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.547061 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.547563 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.547740 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.548083 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.548588 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.548899 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.549213 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.549521 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.549830 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.550155 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.550464 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.550802 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.551128 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.551516 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.551741 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.552061 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.552371 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.552679 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.553000 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.553304 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.553612 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.553934 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.554246 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.554635 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.554896 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.555306 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.555631 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.555942 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.556796 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.557227 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.559402 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.559402 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.559402 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.559402 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.559402 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.559402 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.560263 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.560263 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.560263 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.560704 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.560857 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.561079 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.561416 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.561739 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.562056 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.562377 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.562737 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.563054 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.563371 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.563689 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.564011 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.564333 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.564667 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.564983 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.565300 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.565623 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.565939 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.566258 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.566616 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.566948 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.567263 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.567609 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.567988 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.568274 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.568601 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.568932 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.569435 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.569600 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.569974 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.570194 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.570555 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.571038 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.571317 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.571646 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.572723 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.573049 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.573370 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.573690 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.574041 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.574366 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.574718 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.575142 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.575358 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.575674 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.575992 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.576307 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.576619 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.576930 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.577241 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.577558 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.577868 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.578195 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.578581 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.578873 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.579215 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.579725 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.579880 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.580145 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.580460 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.580815 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.581150 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.581469 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.581782 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.582114 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.582430 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.582755 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.583088 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.583398 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.583707 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.584028 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.584345 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.584659 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.584974 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.585290 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.585612 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.585928 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.586241 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.586680 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.587061 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.587445 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.587781 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.588105 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.588427 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.588733 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.589046 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.589354 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.589878 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.590055 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.590272 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.590604 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.590964 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.591219 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.591525 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.591831 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.592234 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.592468 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.592805 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.593080 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.593386 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.593737 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.594047 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.594395 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.594784 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.595111 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.595441 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.595752 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.596072 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.596386 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.596786 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.597007 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.597312 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.597688 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.598005 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.598330 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.598672 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.599071 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.599319 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.599646 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.600726 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.600726 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.600726 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.601291 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.601291 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.601591 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.601848 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.602164 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.602688 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.603008 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.603520 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.603783 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.604011 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.604385 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.604714 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.605032 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.605365 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.605686 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.606007 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.606318 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.606664 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.607003 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.607339 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.607651 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.607968 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.608294 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.608612 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.608926 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.609241 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.609552 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.609869 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.610225 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.610527 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.610919 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.611143 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.611454 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.611770 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.612084 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.612392 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.612699 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.613014 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.613342 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.613656 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.613983 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.614308 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.614639 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.615002 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.615274 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.615588 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.615899 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.616207 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.616514 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.616860 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.617174 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.617484 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.617805 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.618131 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.618468 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.619480 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.619942 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.620293 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.620595 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.620945 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.621228 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.621543 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.621857 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.622173 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.622492 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.622846 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.623160 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.623478 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.623794 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.624105 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.624421 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.624744 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.625326 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.625664 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.625989 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.626312 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.626684 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.626982 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.627316 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.627645 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.627807 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 03:51:20.628299 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.628459 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 03:51:20.628662 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.628817 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 03:51:20.628964 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.628964 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.629259 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 03:51:20.629259 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 03:51:20.629545 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.629545 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.629836 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.630007 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.630163 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.630327 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.630606 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.630769 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.630937 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.631244 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.631406 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.631552 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.631798 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.631961 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.632108 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.632268 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.632427 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.632579 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.632732 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.632978 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.633149 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.633304 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.633603 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.633813 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.634056 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854260-1-iscsi {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.634298 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.635167 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.635423 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.635687 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.635896 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.636068 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.636322 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.636492 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.636639 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.636811 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.637085 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.637239 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.637384 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.637541 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.637695 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.637842 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.638019 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.638168 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.638323 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.638479 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.638719 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.638873 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.639027 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.639174 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.639334 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.639489 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.639634 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.639791 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.639943 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.640102 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.640257 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.640412 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.640576 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.640826 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.640984 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.641369 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.641528 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.641528 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.641842 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854260-1-iscsi {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.642114 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.642289 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.642446 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.642651 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.642800 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.642974 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.643207 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.643375 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.643526 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.643781 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.643932 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.644087 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.644317 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.644467 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.644634 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.644782 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.644935 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.645081 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.645240 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.645388 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.645539 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.645686 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.645839 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.645995 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.646150 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.646323 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.646600 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.646765 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.646911 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.647076 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.647327 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.647479 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.647633 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.647788 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.647934 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.648090 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.648237 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.648390 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.648544 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.648702 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.648899 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.649064 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.649218 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.649366 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.649519 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.649673 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.649845 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.650100 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.650345 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.650544 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.650544 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.650954 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.650954 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.651253 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.651577 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.651742 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.651894 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.652067 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.652310 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.652462 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.652462 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.652743 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.652896 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.653061 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.653236 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.653466 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.653617 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.653780 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.654007 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.654169 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.654317 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.654470 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.654663 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.654810 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.654964 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.655125 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.655295 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.655449 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.655603 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.655756 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.655909 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.656065 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.656222 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.82 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.656375 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.656537 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.82 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.656766 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.656917 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.657072 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.657229 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.657508 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.657663 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.657808 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.657964 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.658110 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.658257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.658402 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.658605 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.658757 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.658958 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.659109 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.659257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.659420 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.659577 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.659724 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.659879 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.660034 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.660188 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.660335 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.660487 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.660487 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.660783 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.660950 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.661179 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.661339 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.661515 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.661836 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.661991 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.662251 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.662552 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.662708 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.662853 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.663012 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.663158 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.663322 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.663661 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.663837 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.664006 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.664251 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.664410 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.664591 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.664752 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.664907 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.665063 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.665224 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.665379 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.665551 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.665705 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.665861 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.666008 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.666234 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.666416 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.666595 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.666773 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.667022 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.667189 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.667345 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.667517 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.667777 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.667943 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.668091 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.668249 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.668397 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.668542 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.668721 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.668876 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.669066 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.669216 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.669374 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.669520 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.669679 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.669827 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.669980 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.670133 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.670279 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.670279 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.670649 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.670815 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.670969 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.671125 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.671373 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.671539 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.671539 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.671994 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.672149 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.672302 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.672476 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.672716 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.672869 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.673034 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.673182 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.673580 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.673828 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.673996 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.674144 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.674384 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.674556 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.674719 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.674875 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.674875 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.675171 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.675318 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.675474 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.675620 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.675882 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.676046 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.676193 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.676339 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.676491 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.676643 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.676802 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.676956 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.677195 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.677354 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.677509 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.677668 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.677924 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.678079 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:51:20.678225 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.678379 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.678551 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.678715 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.678872 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.679026 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.679220 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.679384 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.679530 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.679697 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.679846 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.679999 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.680162 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.680416 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.680675 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.680935 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.681183 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.681469 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.681845 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.682941 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.683188 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.683363 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.683529 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.683683 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.683853 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.684092 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.684261 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.684518 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.684686 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.684927 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.685091 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.685245 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.685414 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.685577 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.685577 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.685903 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.686059 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.686219 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.686382 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.686556 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.686731 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.686887 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.687053 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.687230 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.687484 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.687650 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.687751 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.687833 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.687833 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.688013 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.688104 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.688199 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.688287 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.688373 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.688373 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.688541 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.688541 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.688703 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.688798 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.688892 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.688988 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.689089 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.689327 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.689421 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.689509 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.689598 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.689693 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.689796 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.689885 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.689978 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.690065 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.690152 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.690252 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.690351 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.690447 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.690565 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.690667 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.690757 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.690857 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.690947 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.691040 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.691136 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.691224 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.691311 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.691406 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.691503 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.691591 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.691678 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.691779 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.691874 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.691972 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.692061 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.692154 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.692256 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.692351 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.692460 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.692789 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.692789 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.692789 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.692789 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.692789 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.693890 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.693992 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.693992 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.693992 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.693992 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.694340 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.694438 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.694438 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.694438 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.694438 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.694438 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.694438 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.694438 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.695300 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.695391 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.695391 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.695550 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.695652 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.695652 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.695891 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.695988 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.696084 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.696172 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.696172 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.696172 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.696428 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.696522 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.696522 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.696522 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.696522 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.696522 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.697027 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.697125 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.697125 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.697423 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.697423 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.697858 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.697956 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.698107 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.698394 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.698604 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.698735 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.699070 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.699189 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.699362 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.699617 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.699738 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.699962 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.700234 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.700335 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.700568 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.700840 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.700943 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.701204 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.701434 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.701527 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.701829 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.702028 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.702132 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.702456 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.702634 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.702962 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.703114 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.703240 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.703433 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.703745 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.703847 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.704061 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.704345 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.704454 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.704693 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.705095 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.705285 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.705576 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.705740 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.705898 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.706107 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.706458 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.706624 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.706825 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.707025 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.707181 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.707457 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.707607 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.707845 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.707989 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.708152 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.708386 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.708615 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.708764 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.709006 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.709156 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.709358 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.709719 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.709884 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.710079 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.710907 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.711075 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.711240 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.711400 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.711544 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.711701 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.711701 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.711986 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.712140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.712140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.713340 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.713580 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.713731 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.713885 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.714033 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.714201 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.714201 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.714471 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.714630 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.714630 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.715088 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.715319 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.715476 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.715630 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.715630 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.715927 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.716081 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.716235 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.716377 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.716531 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.716680 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.716834 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.717024 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.717178 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.717341 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.717675 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.718752 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.718922 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.719085 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.719228 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.719438 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.719604 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.719747 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.719858 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.719858 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.720586 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.720678 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.720782 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.720879 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.720975 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.721072 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.721072 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.721072 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.721322 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.721411 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.721679 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.721881 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.722012 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.722326 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.722429 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.722661 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.722939 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.723042 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.723383 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.723545 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.723655 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.723889 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.724126 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.724223 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.724500 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.724726 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.724821 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.725180 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.725299 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.725725 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.725829 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.726077 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.726312 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.726409 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.726743 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.726989 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.727096 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.727384 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.727569 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.727715 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.728071 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.728179 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.728470 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.728784 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.728900 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.729105 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.729423 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.729572 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.729736 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.730018 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.730121 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.730354 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.730645 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.730752 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.730996 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.731234 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.731337 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.731606 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.731850 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.731952 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.732232 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.732442 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.732543 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.732834 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.733049 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.733157 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.733469 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.733638 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.733734 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.734038 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.734266 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.734372 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.734671 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.734902 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.735010 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.735293 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.735502 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.735612 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.735881 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.736124 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.736227 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.736485 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.736736 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.736911 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.737100 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.737367 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.737468 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.737745 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.737995 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.738103 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.738369 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.738610 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.738711 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.739364 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.739462 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.739687 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.739687 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.739897 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.739994 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.743114 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.743264 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.743360 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.744415 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.744527 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.744620 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.744710 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.744798 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.744896 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.744995 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.745085 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.745172 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.745266 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.745553 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.745644 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.745746 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.745746 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.745746 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.745989 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.746086 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.746176 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.746278 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.746278 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.746278 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.746606 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.746698 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.746698 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.746698 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.746698 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.747035 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.747035 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.747266 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.747376 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.747624 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.747936 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.748257 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.748605 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.748929 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.749250 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.749570 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.749891 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.750240 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.750533 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.750856 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.751540 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.751540 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.751856 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.752112 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.752598 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.753464 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.753728 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.753881 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.754182 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.754182 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.754753 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.754845 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.754943 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.755040 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.755040 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.755221 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.755311 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.755311 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.755670 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.755780 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.755879 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.755978 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.756260 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.756355 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.756614 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.756814 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.756948 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.757269 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.757365 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.757577 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.757789 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.757893 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.758182 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.758304 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.758555 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.758780 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.758888 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.759144 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.759921 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.760087 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.761550 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.762312 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.762421 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.762560 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.762673 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.762767 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.762856 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.762954 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.763043 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.763590 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.763953 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.764064 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.764154 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.764154 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.764551 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.764674 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.764674 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.764840 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.766014 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.766377 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.766494 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.766624 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.766726 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.766726 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.766891 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.766987 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.766987 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.767267 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.767376 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.767473 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.767573 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.767663 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.767751 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.767927 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.768025 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.768115 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.768215 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.768215 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.768215 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.768471 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.768568 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.768568 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.768746 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.768838 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.768838 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.769011 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.769099 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.769099 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.769267 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.769361 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.769529 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.769766 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.769869 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.770142 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.770275 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.770459 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.770744 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.770843 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.771098 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.771256 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.771413 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.771710 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.771806 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.772057 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.772235 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.772368 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.772695 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.772799 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.773014 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.773207 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.773336 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.773655 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.773750 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.773967 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.774164 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.774298 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.774699 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.774890 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.775067 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.775224 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.775347 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.775588 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.775696 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.775893 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.776118 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.776226 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.776512 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.776615 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.776922 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.777033 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.777142 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.777441 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.777537 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.777906 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.778348 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.778635 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.778754 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.778969 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.779172 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.779285 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.779616 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.780225 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.780576 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.780908 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.781242 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.781577 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.781800 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.781917 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.782158 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.782323 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.782667 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.782771 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.783022 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.783138 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.783340 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.783466 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.783702 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.783815 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.784039 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.784220 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.784220 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 03:51:20.784522 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.784703 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.784945 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.785195 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.785508 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.785827 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.786142 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.786454 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.786789 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.787101 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.787423 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.787768 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.788061 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.788372 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.788698 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.789014 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.789325 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.789637 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.789945 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.790294 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.790658 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.791397 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.791397 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.791667 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.791984 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.792294 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.792626 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.792937 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.793246 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.793554 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.793870 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.794188 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.794495 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.794832 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.795147 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.795464 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.795781 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.796089 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.796408 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.796715 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.797035 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.797348 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.797661 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.797972 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.798582 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.798881 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.799190 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.799504 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.799812 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.800133 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.800442 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.800751 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.801058 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.801371 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.801684 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.801994 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.802320 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.802658 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.802973 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.803283 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.803597 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.803908 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.804215 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.804530 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.804857 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.805180 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.805488 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.805805 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.806647 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.807260 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.807436 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.807755 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.808067 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.808382 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.808690 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.809000 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.809310 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.809638 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.809960 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.810272 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.810613 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.810926 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.811277 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.811590 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.811955 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.812271 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.812593 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.812977 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.813287 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.813605 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.813925 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.814236 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.814773 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.814900 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.815196 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.815526 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.815807 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.816134 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.816455 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.816824 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.817150 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.817479 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.817810 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.818127 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.818442 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.818785 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.819099 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.819413 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.819727 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.820043 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.820356 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.820671 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.820990 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.821307 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.821620 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.822725 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.823053 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.823362 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.823695 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.824028 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.824327 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.825515 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.825515 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.825515 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.825515 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.827416 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.827416 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.827416 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.827416 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.827416 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.827855 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.827944 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.828937 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.828937 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.828937 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.829209 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.829510 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.829824 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.830197 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.830535 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.830904 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.831188 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.831498 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.831805 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.832113 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.832438 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.832750 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.833073 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.833494 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.833808 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.834119 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.834558 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.834878 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.835193 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.835519 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.835846 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.836175 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.836484 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.836799 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.837114 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.837628 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.837628 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.838281 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.838592 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.838905 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.839234 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.839567 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.839888 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.840216 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.840635 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.840964 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.841283 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.841615 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.841949 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.842261 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.842594 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.842912 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.843223 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.843540 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.843857 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.844170 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.844491 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.844809 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.845125 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.845432 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.845740 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.846068 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.846376 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.846684 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO dbcounter [None req-01d32176-af6b-4a39-843f-59514eb0bfbb None None] Registered counter for database nova_api Aug 24 03:51:20.856319 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.856319 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.856319 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.856319 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.856319 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.856319 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.856319 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.856319 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.856970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.856970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.856970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.856970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.856970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.856970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.856970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.856970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.857572 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.857572 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.857572 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.857572 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.857572 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.857572 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.857572 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.857572 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.858305 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.858305 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.858305 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.858305 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.858305 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.858305 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.858305 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.858305 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.858947 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.858947 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.858947 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.858947 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.858947 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.858947 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.858947 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.859466 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.859466 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.859791 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.860118 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.860492 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.860759 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.861076 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.861393 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.861714 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.862033 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.862615 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.863968 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.864579 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.864902 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.865254 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.865881 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.866142 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.866491 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.866813 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.867155 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.867464 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.867787 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.868110 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.868433 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.869328 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_db.sqlalchemy.engines [None req-01d32176-af6b-4a39-843f-59514eb0bfbb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127869) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:51:20.870132 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.870500 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.870897 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.871259 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.871617 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.871988 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.872399 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.872742 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.873084 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.873423 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.873805 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.874143 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.874469 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.874828 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.875163 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.875495 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.875826 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.876120 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writer thread running {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:51:20.876229 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.876470 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.876799 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.877124 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.877742 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.877861 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.878091 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.878429 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.878803 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.879142 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.879468 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.879794 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.880125 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.880693 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.881022 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.881372 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.881710 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.882047 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.882376 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.882745 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.883088 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.883409 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.883728 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.884051 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.884986 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.885324 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.885670 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.886002 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.886327 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.886689 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.887017 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.887654 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.888022 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.888357 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.888700 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.889040 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.889375 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.889698 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.890038 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.890357 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.890703 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.891037 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.891361 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.891679 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.891998 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.892324 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.892647 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.892962 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.893284 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.893599 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.893934 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.894250 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.894586 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.894904 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.895225 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.895540 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.895856 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.896169 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.896482 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.896802 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.897115 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.897433 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.897746 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.898064 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.898381 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.898716 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.899039 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.899371 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.899685 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.900588 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.900925 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.901251 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.901589 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.901916 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.902239 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.902622 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.902954 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.903504 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.903850 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.904181 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.904528 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.904868 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.905186 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.905500 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.905817 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.906149 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.906486 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.906891 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.907215 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.907537 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.907861 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.908183 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.908516 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.908828 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.909151 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.909470 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.909789 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.910149 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.910454 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.910799 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.911126 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.911475 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.911849 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.912186 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.912514 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.912843 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.913165 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.913486 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.913808 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.914129 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.914453 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.914843 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.915138 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.915946 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.916970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.917302 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.917637 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.917971 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.918296 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.918656 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.918997 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.919326 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.919660 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.919993 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.920326 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.920681 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.921022 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.921362 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.921677 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.921991 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.922307 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.922651 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.922982 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.923568 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.923892 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.924204 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.924524 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.924838 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.925154 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.925468 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.925782 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.926099 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.926411 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.926749 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.927061 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.927373 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.927688 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.927998 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.928315 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.928627 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.928945 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.929255 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.929569 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.929910 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.930254 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.930622 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.930949 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.932369 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.932708 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.933054 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.933383 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.933723 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.933990 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.context [None req-01d32176-af6b-4a39-843f-59514eb0bfbb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a161133a-c4eb-4e12-9be8-d257b8daa02d(cell1) {{(pid=127869) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 03:51:20.934098 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.934380 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.934731 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.935109 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.935475 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.935799 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.936124 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.936448 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.936769 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.937095 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.937431 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.937767 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.938083 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-01d32176-af6b-4a39-843f-59514eb0bfbb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:20.938182 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.938413 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.938579 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-01d32176-af6b-4a39-843f-59514eb0bfbb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:20.938764 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.939096 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.939426 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.939747 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.940085 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.940190 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-01d32176-af6b-4a39-843f-59514eb0bfbb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:20.940482 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.940781 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.940894 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-01d32176-af6b-4a39-843f-59514eb0bfbb None None] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:20.941098 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.941291 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-01d32176-af6b-4a39-843f-59514eb0bfbb None None] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:20.941416 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.941735 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.942060 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.942380 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.942723 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.943053 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.943286 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-01d32176-af6b-4a39-843f-59514eb0bfbb None None] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:20.943440 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.943700 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.944036 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.944354 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.944692 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.945029 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.945261 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO dbcounter [None req-01d32176-af6b-4a39-843f-59514eb0bfbb None None] Registered counter for database nova_cell0 Aug 24 03:51:20.945418 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.945689 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.946044 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.946443 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.946999 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.947518 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.947842 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:51:20.948095 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 03:51:20.949314 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO dbcounter [None req-01d32176-af6b-4a39-843f-59514eb0bfbb None None] Registered counter for database nova_cell1 Aug 24 03:51:20.957298 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_db.sqlalchemy.engines [None req-01d32176-af6b-4a39-843f-59514eb0bfbb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127869) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:51:20.959967 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_db.sqlalchemy.engines [None req-01d32176-af6b-4a39-843f-59514eb0bfbb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127869) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:51:20.967429 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writer thread running {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:51:20.970627 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writer thread running {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:51:21.015064 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO dbcounter [None req-550a2bf5-a69b-4250-8a21-ef1a80012bcd None None] Registered counter for database nova_api Aug 24 03:51:21.036175 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_db.sqlalchemy.engines [None req-550a2bf5-a69b-4250-8a21-ef1a80012bcd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127870) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:51:21.043969 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writer thread running {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:51:21.102411 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.context [None req-550a2bf5-a69b-4250-8a21-ef1a80012bcd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a161133a-c4eb-4e12-9be8-d257b8daa02d(cell1) {{(pid=127870) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 03:51:21.107670 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-550a2bf5-a69b-4250-8a21-ef1a80012bcd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:21.108154 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-550a2bf5-a69b-4250-8a21-ef1a80012bcd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:21.109745 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-550a2bf5-a69b-4250-8a21-ef1a80012bcd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:21.110576 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-550a2bf5-a69b-4250-8a21-ef1a80012bcd None None] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:21.110977 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-550a2bf5-a69b-4250-8a21-ef1a80012bcd None None] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:21.112971 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-550a2bf5-a69b-4250-8a21-ef1a80012bcd None None] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:21.115011 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO dbcounter [None req-550a2bf5-a69b-4250-8a21-ef1a80012bcd None None] Registered counter for database nova_cell0 Aug 24 03:51:21.118225 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO dbcounter [None req-01d32176-af6b-4a39-843f-59514eb0bfbb None None] Registered counter for database nova_cell0 Aug 24 03:51:21.120156 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO dbcounter [None req-550a2bf5-a69b-4250-8a21-ef1a80012bcd None None] Registered counter for database nova_cell1 Aug 24 03:51:21.125943 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_db.sqlalchemy.engines [None req-01d32176-af6b-4a39-843f-59514eb0bfbb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127869) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:51:21.127281 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_db.sqlalchemy.engines [None req-550a2bf5-a69b-4250-8a21-ef1a80012bcd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127870) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:51:21.130811 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_db.sqlalchemy.engines [None req-550a2bf5-a69b-4250-8a21-ef1a80012bcd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127870) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:51:21.130965 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writer thread running {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:51:21.132886 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writer thread running {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:51:21.287485 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writer thread running {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:51:21.298384 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO dbcounter [None req-550a2bf5-a69b-4250-8a21-ef1a80012bcd None None] Registered counter for database nova_cell0 Aug 24 03:51:21.305005 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_db.sqlalchemy.engines [None req-550a2bf5-a69b-4250-8a21-ef1a80012bcd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127870) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:51:21.309905 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writer thread running {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:51:21.456513 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: WARNING keystonemiddleware.auth_token [None req-01d32176-af6b-4a39-843f-59514eb0bfbb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:51:21.464481 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: WARNING keystonemiddleware.auth_token [None req-01d32176-af6b-4a39-843f-59514eb0bfbb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:51:21.645711 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: WARNING keystonemiddleware.auth_token [None req-550a2bf5-a69b-4250-8a21-ef1a80012bcd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:51:21.654878 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: WARNING keystonemiddleware.auth_token [None req-550a2bf5-a69b-4250-8a21-ef1a80012bcd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:51:21.811153 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: WARNING keystonemiddleware.auth_token [None req-01d32176-af6b-4a39-843f-59514eb0bfbb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:51:21.817766 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: WARNING keystonemiddleware.auth_token [None req-01d32176-af6b-4a39-843f-59514eb0bfbb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:51:21.823601 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563a8ae179c0 pid: 127869 (default app) Aug 24 03:51:22.014190 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: WARNING keystonemiddleware.auth_token [None req-550a2bf5-a69b-4250-8a21-ef1a80012bcd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:51:22.020618 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: WARNING keystonemiddleware.auth_token [None req-550a2bf5-a69b-4250-8a21-ef1a80012bcd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:51:22.026376 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563a8ae179c0 pid: 127870 (default app) Aug 24 03:51:59.312438 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_api:SELECT=3 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:59.320371 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell1:SELECT=3 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:59.320371 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell0:SELECT=3 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:59.320371 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell0:SELECT=3 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:59.566551 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:59.567369 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:59.568512 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:59.569608 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:00.516798 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-6e7d206c-081e-4d19-bb46-b587cb3809ff tempest-VolumesGetTestJSON-881255752 tempest-VolumesGetTestJSON-881255752-project] Action: 'create', calling method: .version_select at 0x7f15562295e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2032799504", "metadata": {"Type": "work"}}} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:00.691156 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cbeb8d36-f2e6-4e87-87e9-3e93c96ebc04 tempest-VolumesNegativeTest-1376032792 tempest-VolumesNegativeTest-1376032792-project] Action: 'create', calling method: .version_select at 0x7f155622b820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1950475758", "metadata": {"Type": "work"}}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:00.719845 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cbeb8d36-f2e6-4e87-87e9-3e93c96ebc04 tempest-VolumesNegativeTest-1376032792 tempest-VolumesNegativeTest-1376032792-project] Request method failure captured: Aug 24 03:52:00.719845 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 03:52:00.719845 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept: application/json Aug 24 03:52:00.719845 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept-Encoding: identity Aug 24 03:52:00.719845 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Connection: close Aug 24 03:52:00.719845 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Length: 122 Aug 24 03:52:00.719845 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Type: application/json Aug 24 03:52:00.719845 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Host: 10.222.0.82 Aug 24 03:52:00.719845 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Openstack-System-Scope: None Aug 24 03:52:00.719845 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.11 Aug 24 03:52:00.719845 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Auth-Token: gAAAAABjBaBf3WfA0kTP_c0a8sYtBz6drbeynGar4nWr_JOedrY5eERj5m_mutahbEHGWabnG7QqTNfuquFUPFwyT0fU4QQ1XQhFM_40HS0S9_U_7IeN7yrFQ6RB2c1ouP5iDiayxhuRnVasNp2usUIgswuXkkcOBEqO0saOHdB5KUekuqVzbPw Aug 24 03:52:00.719845 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Id: None Aug 24 03:52:00.719845 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Name: None Aug 24 03:52:00.719845 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Identity-Status: Confirmed Aug 24 03:52:00.719845 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Is-Admin-Project: True Aug 24 03:52:00.719845 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Id: default Aug 24 03:52:00.719845 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Name: Default Aug 24 03:52:00.719845 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Id: 798e09b25ee042b49d1df467b70d4fc4 Aug 24 03:52:00.719845 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Name: tempest-VolumesNegativeTest-1376032792 Aug 24 03:52:00.719845 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Role: member,reader Aug 24 03:52:00.719845 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Roles: member,reader Aug 24 03:52:00.722300 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/798e09b25ee042b49d1df467b70d4fc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/798e09b25ee042b49d1df467b70d4fc4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/798e09b25ee042b49d1df467b70d4fc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_798e09b25ee042b49d1df467b70d4fc4", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:52:00.722300 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant: tempest-VolumesNegativeTest-1376032792 Aug 24 03:52:00.722300 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Id: 798e09b25ee042b49d1df467b70d4fc4 Aug 24 03:52:00.722300 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Name: tempest-VolumesNegativeTest-1376032792 Aug 24 03:52:00.722300 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User: tempest-VolumesNegativeTest-1376032792-project Aug 24 03:52:00.722300 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Id: default Aug 24 03:52:00.722300 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Name: Default Aug 24 03:52:00.722300 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Id: 0158925721c1446483b19f9957425732 Aug 24 03:52:00.722300 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Name: tempest-VolumesNegativeTest-1376032792-project Aug 24 03:52:00.722300 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Aug 24 03:52:00.722300 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1950475758", "metadata": {"Type": "work"}}} Aug 24 03:52:00.722300 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: method: Aug 24 03:52:00.722300 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 03:52:00.723186 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1950475758', 'metadata': {'Type': 'work'}}}} Aug 24 03:52:00.723186 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:52:00.723186 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:00.723186 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:52:00.723186 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:52:00.723186 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:52:00.723186 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:52:00.723186 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 03:52:00.723186 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.723186 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 03:52:00.723186 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 03:52:00.723186 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.723186 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 03:52:00.723186 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 03:52:00.723186 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.723186 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:52:00.723186 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.723186 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:00.723186 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:52:00.723186 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:52:00.723186 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:52:00.723186 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:52:00.727037 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:52:00.727037 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:52:00.727037 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:52:00.727037 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:52:00.727037 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:52:00.727037 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:52:00.727037 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:52:00.727037 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:52:00.727037 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:52:00.727037 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:52:00.727037 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 03:52:00.727037 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.727037 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:52:00.727037 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.727037 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:00.727037 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:52:00.727037 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:52:00.727037 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:52:00.727037 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:52:00.729344 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 03:52:00.729344 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.729344 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cbeb8d36-f2e6-4e87-87e9-3e93c96ebc04 tempest-VolumesNegativeTest-1376032792 tempest-VolumesNegativeTest-1376032792-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:52:00.729344 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cbeb8d36-f2e6-4e87-87e9-3e93c96ebc04 tempest-VolumesNegativeTest-1376032792 tempest-VolumesNegativeTest-1376032792-project] 10.222.0.82 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.150746 Aug 24 03:52:00.729344 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 1/1] 10.222.0.82 () {60 vars in 1156 bytes} [Wed Aug 24 03:51:59 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1153 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:52:00.734357 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7aeba966-62b3-4b2e-a2d1-b46d07c231c7 tempest-VolumesNegativeTest-1376032792 tempest-VolumesNegativeTest-1376032792-project] Action: 'create', calling method: .version_select at 0x7f155622b820>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-939867227", "metadata": {"Type": "work"}}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:00.747027 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7aeba966-62b3-4b2e-a2d1-b46d07c231c7 tempest-VolumesNegativeTest-1376032792 tempest-VolumesNegativeTest-1376032792-project] Request method failure captured: Aug 24 03:52:00.747027 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 03:52:00.747027 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept: application/json Aug 24 03:52:00.747027 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept-Encoding: identity Aug 24 03:52:00.747027 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Connection: close Aug 24 03:52:00.747027 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Length: 119 Aug 24 03:52:00.747027 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Type: application/json Aug 24 03:52:00.747027 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Host: 10.222.0.82 Aug 24 03:52:00.747027 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Openstack-System-Scope: None Aug 24 03:52:00.747027 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.11 Aug 24 03:52:00.747027 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Auth-Token: gAAAAABjBaBf3WfA0kTP_c0a8sYtBz6drbeynGar4nWr_JOedrY5eERj5m_mutahbEHGWabnG7QqTNfuquFUPFwyT0fU4QQ1XQhFM_40HS0S9_U_7IeN7yrFQ6RB2c1ouP5iDiayxhuRnVasNp2usUIgswuXkkcOBEqO0saOHdB5KUekuqVzbPw Aug 24 03:52:00.747027 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Id: None Aug 24 03:52:00.747027 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Name: None Aug 24 03:52:00.747027 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Identity-Status: Confirmed Aug 24 03:52:00.747027 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Is-Admin-Project: True Aug 24 03:52:00.747027 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Id: default Aug 24 03:52:00.747027 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Name: Default Aug 24 03:52:00.747027 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Id: 798e09b25ee042b49d1df467b70d4fc4 Aug 24 03:52:00.747027 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Name: tempest-VolumesNegativeTest-1376032792 Aug 24 03:52:00.747027 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Role: member,reader Aug 24 03:52:00.747027 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Roles: member,reader Aug 24 03:52:00.748777 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/798e09b25ee042b49d1df467b70d4fc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/798e09b25ee042b49d1df467b70d4fc4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/798e09b25ee042b49d1df467b70d4fc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_798e09b25ee042b49d1df467b70d4fc4", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:52:00.748777 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant: tempest-VolumesNegativeTest-1376032792 Aug 24 03:52:00.748777 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Id: 798e09b25ee042b49d1df467b70d4fc4 Aug 24 03:52:00.748777 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Name: tempest-VolumesNegativeTest-1376032792 Aug 24 03:52:00.748777 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User: tempest-VolumesNegativeTest-1376032792-project Aug 24 03:52:00.748777 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Id: default Aug 24 03:52:00.748777 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Name: Default Aug 24 03:52:00.748777 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Id: 0158925721c1446483b19f9957425732 Aug 24 03:52:00.748777 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Name: tempest-VolumesNegativeTest-1376032792-project Aug 24 03:52:00.748777 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Aug 24 03:52:00.748777 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-939867227", "metadata": {"Type": "work"}}} Aug 24 03:52:00.748777 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: method: Aug 24 03:52:00.748777 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 03:52:00.750782 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-939867227', 'metadata': {'Type': 'work'}}}} Aug 24 03:52:00.750782 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:52:00.750782 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:00.750782 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:52:00.750782 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:52:00.750782 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:52:00.750782 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:52:00.750782 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 03:52:00.750782 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.750782 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 03:52:00.750782 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 03:52:00.750782 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.750782 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 03:52:00.750782 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi '0' Aug 24 03:52:00.750782 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.750782 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:52:00.750782 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.750782 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:00.750782 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:52:00.750782 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:52:00.750782 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:52:00.750782 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:52:00.752561 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:52:00.752561 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:52:00.752561 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:52:00.752561 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:52:00.752561 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:52:00.752561 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:52:00.752561 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:52:00.752561 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:52:00.752561 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:52:00.752561 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:52:00.752561 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 03:52:00.752561 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.752561 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:52:00.752561 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.752561 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:00.752561 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:52:00.752561 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:52:00.752561 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:52:00.752561 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:52:00.754709 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 03:52:00.754709 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.754709 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7aeba966-62b3-4b2e-a2d1-b46d07c231c7 tempest-VolumesNegativeTest-1376032792 tempest-VolumesNegativeTest-1376032792-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:52:00.754709 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7aeba966-62b3-4b2e-a2d1-b46d07c231c7 tempest-VolumesNegativeTest-1376032792 tempest-VolumesNegativeTest-1376032792-project] 10.222.0.82 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.027459 Aug 24 03:52:00.763047 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 2/2] 10.222.0.82 () {60 vars in 1156 bytes} [Wed Aug 24 03:52:00 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:52:00.774806 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ea45489a-ffd5-48a5-98f2-945b4d794dc2 tempest-VolumesNegativeTest-1376032792 tempest-VolumesNegativeTest-1376032792-project] Action: 'create', calling method: .version_select at 0x7f15560e9310>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1623984616", "metadata": {"Type": "work"}}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:00.793257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ea45489a-ffd5-48a5-98f2-945b4d794dc2 tempest-VolumesNegativeTest-1376032792 tempest-VolumesNegativeTest-1376032792-project] Request method failure captured: Aug 24 03:52:00.793257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 03:52:00.793257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept: application/json Aug 24 03:52:00.793257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept-Encoding: identity Aug 24 03:52:00.793257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Connection: close Aug 24 03:52:00.793257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Length: 119 Aug 24 03:52:00.793257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Type: application/json Aug 24 03:52:00.793257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Host: 10.222.0.82 Aug 24 03:52:00.793257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Openstack-System-Scope: None Aug 24 03:52:00.793257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.11 Aug 24 03:52:00.793257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Auth-Token: gAAAAABjBaBf3WfA0kTP_c0a8sYtBz6drbeynGar4nWr_JOedrY5eERj5m_mutahbEHGWabnG7QqTNfuquFUPFwyT0fU4QQ1XQhFM_40HS0S9_U_7IeN7yrFQ6RB2c1ouP5iDiayxhuRnVasNp2usUIgswuXkkcOBEqO0saOHdB5KUekuqVzbPw Aug 24 03:52:00.793257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Id: None Aug 24 03:52:00.793257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Name: None Aug 24 03:52:00.793257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Identity-Status: Confirmed Aug 24 03:52:00.793257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Is-Admin-Project: True Aug 24 03:52:00.793257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Id: default Aug 24 03:52:00.793257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Name: Default Aug 24 03:52:00.793257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Id: 798e09b25ee042b49d1df467b70d4fc4 Aug 24 03:52:00.793257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Name: tempest-VolumesNegativeTest-1376032792 Aug 24 03:52:00.793257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Role: member,reader Aug 24 03:52:00.793257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Roles: member,reader Aug 24 03:52:00.794823 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/798e09b25ee042b49d1df467b70d4fc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/798e09b25ee042b49d1df467b70d4fc4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/798e09b25ee042b49d1df467b70d4fc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_798e09b25ee042b49d1df467b70d4fc4", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:52:00.794823 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant: tempest-VolumesNegativeTest-1376032792 Aug 24 03:52:00.794823 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Id: 798e09b25ee042b49d1df467b70d4fc4 Aug 24 03:52:00.794823 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Name: tempest-VolumesNegativeTest-1376032792 Aug 24 03:52:00.794823 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User: tempest-VolumesNegativeTest-1376032792-project Aug 24 03:52:00.794823 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Id: default Aug 24 03:52:00.794823 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Name: Default Aug 24 03:52:00.794823 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Id: 0158925721c1446483b19f9957425732 Aug 24 03:52:00.794823 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Name: tempest-VolumesNegativeTest-1376032792-project Aug 24 03:52:00.794823 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Aug 24 03:52:00.794823 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1623984616", "metadata": {"Type": "work"}}} Aug 24 03:52:00.794823 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: method: Aug 24 03:52:00.794823 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 03:52:00.796261 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1623984616', 'metadata': {'Type': 'work'}}}} Aug 24 03:52:00.796261 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:52:00.796261 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:00.796261 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:52:00.796261 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:52:00.796261 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:52:00.796261 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:52:00.796261 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 03:52:00.796261 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.796261 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 03:52:00.796261 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 03:52:00.796261 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.796261 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 03:52:00.796261 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi '' Aug 24 03:52:00.796261 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.796261 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:52:00.796261 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.796261 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:00.796261 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:52:00.796261 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:52:00.796261 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:52:00.796261 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:52:00.798096 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:52:00.798096 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:52:00.798096 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:52:00.798096 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:52:00.798096 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:52:00.798096 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:52:00.798096 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:52:00.798096 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:52:00.798096 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:52:00.798096 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:52:00.798096 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 03:52:00.798096 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.798096 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:52:00.798096 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.798096 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:00.798096 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:52:00.798096 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:52:00.798096 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:52:00.798096 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:52:00.799469 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 03:52:00.799469 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.799469 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ea45489a-ffd5-48a5-98f2-945b4d794dc2 tempest-VolumesNegativeTest-1376032792 tempest-VolumesNegativeTest-1376032792-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:52:00.799469 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ea45489a-ffd5-48a5-98f2-945b4d794dc2 tempest-VolumesNegativeTest-1376032792 tempest-VolumesNegativeTest-1376032792-project] 10.222.0.82 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015899 Aug 24 03:52:00.799469 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 3/3] 10.222.0.82 () {60 vars in 1156 bytes} [Wed Aug 24 03:52:00 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:52:00.814919 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b81c295a-b1c7-46cd-b1aa-855d2e6e8304 tempest-VolumesNegativeTest-1376032792 tempest-VolumesNegativeTest-1376032792-project] Calling method '.version_select at 0x7f15560e9ca0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:01.267867 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-b81c295a-b1c7-46cd-b1aa-855d2e6e8304 tempest-VolumesNegativeTest-1376032792 tempest-VolumesNegativeTest-1376032792-project] HTTP exception thrown: Volume tempest-invalid-292480368 could not be found. Aug 24 03:52:01.267867 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b81c295a-b1c7-46cd-b1aa-855d2e6e8304 tempest-VolumesNegativeTest-1376032792 tempest-VolumesNegativeTest-1376032792-project] Request method failure captured: Aug 24 03:52:01.267867 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-292480368 HTTP/1.1 Aug 24 03:52:01.267867 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept: application/json Aug 24 03:52:01.267867 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept-Encoding: identity Aug 24 03:52:01.267867 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Connection: close Aug 24 03:52:01.267867 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Length: 0 Aug 24 03:52:01.267867 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Type: application/json Aug 24 03:52:01.267867 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Host: 10.222.0.82 Aug 24 03:52:01.267867 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Openstack-System-Scope: None Aug 24 03:52:01.267867 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.11 Aug 24 03:52:01.267867 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Auth-Token: gAAAAABjBaBf3WfA0kTP_c0a8sYtBz6drbeynGar4nWr_JOedrY5eERj5m_mutahbEHGWabnG7QqTNfuquFUPFwyT0fU4QQ1XQhFM_40HS0S9_U_7IeN7yrFQ6RB2c1ouP5iDiayxhuRnVasNp2usUIgswuXkkcOBEqO0saOHdB5KUekuqVzbPw Aug 24 03:52:01.267867 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Id: None Aug 24 03:52:01.267867 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Name: None Aug 24 03:52:01.267867 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Identity-Status: Confirmed Aug 24 03:52:01.267867 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Is-Admin-Project: True Aug 24 03:52:01.267867 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Id: default Aug 24 03:52:01.267867 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Name: Default Aug 24 03:52:01.267867 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Id: 798e09b25ee042b49d1df467b70d4fc4 Aug 24 03:52:01.267867 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Name: tempest-VolumesNegativeTest-1376032792 Aug 24 03:52:01.267867 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Role: member,reader Aug 24 03:52:01.267867 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Roles: member,reader Aug 24 03:52:01.271460 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/798e09b25ee042b49d1df467b70d4fc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/798e09b25ee042b49d1df467b70d4fc4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/798e09b25ee042b49d1df467b70d4fc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_798e09b25ee042b49d1df467b70d4fc4", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:52:01.271460 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant: tempest-VolumesNegativeTest-1376032792 Aug 24 03:52:01.271460 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Id: 798e09b25ee042b49d1df467b70d4fc4 Aug 24 03:52:01.271460 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Name: tempest-VolumesNegativeTest-1376032792 Aug 24 03:52:01.271460 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User: tempest-VolumesNegativeTest-1376032792-project Aug 24 03:52:01.271460 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Id: default Aug 24 03:52:01.271460 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Name: Default Aug 24 03:52:01.271460 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Id: 0158925721c1446483b19f9957425732 Aug 24 03:52:01.271460 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Name: tempest-VolumesNegativeTest-1376032792-project Aug 24 03:52:01.271460 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: method: Aug 24 03:52:01.271460 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: exception: Volume tempest-invalid-292480368 could not be found. Aug 24 03:52:01.271460 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: action_args: {'id': 'tempest-invalid-292480368'} Aug 24 03:52:01.271460 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:52:01.275214 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:01.275214 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:52:01.275214 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:52:01.275214 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 03:52:01.275214 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 03:52:01.275214 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 03:52:01.275214 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 03:52:01.275214 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 03:52:01.275214 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 03:52:01.275214 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 03:52:01.275214 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 03:52:01.275214 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:52:01.275214 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:52:01.275214 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:52:01.275214 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:52:01.275214 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-292480368 could not be found. (HTTP 404) (Request-ID: req-f1cd5ce6-9750-490c-a916-79c76db5d0cc) Aug 24 03:52:01.275214 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:52:01.275214 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:52:01.275214 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:52:01.277835 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:01.277835 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 03:52:01.277835 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 03:52:01.277835 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:52:01.277835 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:52:01.277835 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 03:52:01.277835 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 03:52:01.277835 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:52:01.277835 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:52:01.277835 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:52:01.277835 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:52:01.277835 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 03:52:01.277835 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 03:52:01.277835 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 03:52:01.277835 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 03:52:01.277835 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 03:52:01.277835 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 03:52:01.277835 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 03:52:01.277835 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 03:52:01.284853 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:52:01.284853 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:52:01.284853 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:52:01.284853 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:52:01.284853 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-292480368 could not be found. Aug 24 03:52:01.284853 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:52:01.284853 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:52:01.284853 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:52:01.284853 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:01.284853 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:52:01.284853 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:52:01.284853 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:52:01.284853 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:52:01.284853 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:52:01.284853 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:52:01.284853 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:52:01.284853 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:52:01.284853 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 03:52:01.284853 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:52:01.284853 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-292480368 could not be found. Aug 24 03:52:01.290085 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:52:01.290085 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:52:01.290085 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:52:01.290085 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:01.290085 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:52:01.290085 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:52:01.290085 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:52:01.290085 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:52:01.290085 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-292480368 could not be found. Aug 24 03:52:01.290085 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:52:01.290085 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b81c295a-b1c7-46cd-b1aa-855d2e6e8304 tempest-VolumesNegativeTest-1376032792 tempest-VolumesNegativeTest-1376032792-project] Returning 404 to user: Volume tempest-invalid-292480368 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:52:01.290085 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b81c295a-b1c7-46cd-b1aa-855d2e6e8304 tempest-VolumesNegativeTest-1376032792 tempest-VolumesNegativeTest-1376032792-project] 10.222.0.82 "DELETE /compute/v2.1/os-volumes/tempest-invalid-292480368" status: 404 len: 98 microversion: 2.1 time: 0.411466 Aug 24 03:52:01.290085 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 4/4] 10.222.0.82 () {58 vars in 1215 bytes} [Wed Aug 24 03:52:00 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-292480368 => generated 98 bytes in 413 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:52:01.293069 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-537481ba-7fa2-4873-baef-15640c70da76 tempest-VolumesNegativeTest-1376032792 tempest-VolumesNegativeTest-1376032792-project] 10.222.0.82 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009316 Aug 24 03:52:01.293069 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 5/5] 10.222.0.82 () {58 vars in 1140 bytes} [Wed Aug 24 03:52:01 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 03:52:01.293069 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-19423e57-3fba-4513-bd88-c3417362359d tempest-VolumesNegativeTest-1376032792 tempest-VolumesNegativeTest-1376032792-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004943 Aug 24 03:52:01.293069 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 6/6] 10.222.0.82 () {58 vars in 1137 bytes} [Wed Aug 24 03:52:01 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 03:52:01.293069 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ae5f4da0-6625-4106-9eec-7af953719403 tempest-VolumesNegativeTest-1376032792 tempest-VolumesNegativeTest-1376032792-project] Calling method '.version_select at 0x7f1556099550>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:02.461909 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-ae5f4da0-6625-4106-9eec-7af953719403 tempest-VolumesNegativeTest-1376032792 tempest-VolumesNegativeTest-1376032792-project] HTTP exception thrown: Volume 3cafa71c-65af-4b00-9348-0ccbae65bbd0 could not be found. Aug 24 03:52:02.470642 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ae5f4da0-6625-4106-9eec-7af953719403 tempest-VolumesNegativeTest-1376032792 tempest-VolumesNegativeTest-1376032792-project] Request method failure captured: Aug 24 03:52:02.470642 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: request: DELETE /compute/v2.1/os-volumes/3cafa71c-65af-4b00-9348-0ccbae65bbd0 HTTP/1.1 Aug 24 03:52:02.470642 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept: application/json Aug 24 03:52:02.470642 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept-Encoding: identity Aug 24 03:52:02.470642 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Connection: close Aug 24 03:52:02.470642 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Length: 0 Aug 24 03:52:02.470642 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Type: application/json Aug 24 03:52:02.470642 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Host: 10.222.0.82 Aug 24 03:52:02.470642 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Openstack-System-Scope: None Aug 24 03:52:02.470642 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.11 Aug 24 03:52:02.470642 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Auth-Token: gAAAAABjBaBf3WfA0kTP_c0a8sYtBz6drbeynGar4nWr_JOedrY5eERj5m_mutahbEHGWabnG7QqTNfuquFUPFwyT0fU4QQ1XQhFM_40HS0S9_U_7IeN7yrFQ6RB2c1ouP5iDiayxhuRnVasNp2usUIgswuXkkcOBEqO0saOHdB5KUekuqVzbPw Aug 24 03:52:02.470642 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Id: None Aug 24 03:52:02.470642 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Name: None Aug 24 03:52:02.470642 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Identity-Status: Confirmed Aug 24 03:52:02.470642 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Is-Admin-Project: True Aug 24 03:52:02.470642 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Id: default Aug 24 03:52:02.470642 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Name: Default Aug 24 03:52:02.470642 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Id: 798e09b25ee042b49d1df467b70d4fc4 Aug 24 03:52:02.470642 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Name: tempest-VolumesNegativeTest-1376032792 Aug 24 03:52:02.470642 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Role: member,reader Aug 24 03:52:02.470642 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Roles: member,reader Aug 24 03:52:02.471906 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/798e09b25ee042b49d1df467b70d4fc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/798e09b25ee042b49d1df467b70d4fc4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/798e09b25ee042b49d1df467b70d4fc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_798e09b25ee042b49d1df467b70d4fc4", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:52:02.471906 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant: tempest-VolumesNegativeTest-1376032792 Aug 24 03:52:02.471906 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Id: 798e09b25ee042b49d1df467b70d4fc4 Aug 24 03:52:02.471906 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Name: tempest-VolumesNegativeTest-1376032792 Aug 24 03:52:02.471906 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User: tempest-VolumesNegativeTest-1376032792-project Aug 24 03:52:02.471906 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Id: default Aug 24 03:52:02.471906 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Name: Default Aug 24 03:52:02.471906 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Id: 0158925721c1446483b19f9957425732 Aug 24 03:52:02.471906 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Name: tempest-VolumesNegativeTest-1376032792-project Aug 24 03:52:02.471906 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: method: Aug 24 03:52:02.471906 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: exception: Volume 3cafa71c-65af-4b00-9348-0ccbae65bbd0 could not be found. Aug 24 03:52:02.471906 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: action_args: {'id': '3cafa71c-65af-4b00-9348-0ccbae65bbd0'} Aug 24 03:52:02.471906 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:52:02.472626 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:02.472626 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:52:02.472626 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:52:02.472626 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 03:52:02.472626 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 03:52:02.472626 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 03:52:02.472626 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 03:52:02.472626 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 03:52:02.472626 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 03:52:02.472626 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 03:52:02.472626 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 03:52:02.472626 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:52:02.472626 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:52:02.472626 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:52:02.472626 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:52:02.472626 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3cafa71c-65af-4b00-9348-0ccbae65bbd0 could not be found. (HTTP 404) (Request-ID: req-25b69357-e4b6-47e8-8f9c-08ac79220c14) Aug 24 03:52:02.472626 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:52:02.472626 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:52:02.472626 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:52:02.473616 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:02.473616 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 03:52:02.473616 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 03:52:02.473616 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:52:02.473616 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:52:02.473616 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 03:52:02.473616 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 03:52:02.473616 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:52:02.473616 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:52:02.473616 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:52:02.473616 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:52:02.473616 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 03:52:02.473616 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 03:52:02.473616 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 03:52:02.473616 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 03:52:02.473616 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 03:52:02.473616 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 03:52:02.473616 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 03:52:02.473616 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 03:52:02.474481 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:52:02.474481 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:52:02.474481 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:52:02.474481 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:52:02.474481 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3cafa71c-65af-4b00-9348-0ccbae65bbd0 could not be found. Aug 24 03:52:02.474481 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:52:02.474481 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:52:02.474481 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:52:02.474481 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:02.474481 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:52:02.474481 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:52:02.474481 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:52:02.474481 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:52:02.474481 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:52:02.474481 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:52:02.474481 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:52:02.474481 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:52:02.474481 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 03:52:02.474481 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:52:02.475380 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3cafa71c-65af-4b00-9348-0ccbae65bbd0 could not be found. Aug 24 03:52:02.475380 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:52:02.475380 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:52:02.475380 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:52:02.475380 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:02.475380 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:52:02.475380 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:52:02.475380 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:52:02.475380 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:52:02.475380 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3cafa71c-65af-4b00-9348-0ccbae65bbd0 could not be found. Aug 24 03:52:02.475380 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:52:02.475380 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ae5f4da0-6625-4106-9eec-7af953719403 tempest-VolumesNegativeTest-1376032792 tempest-VolumesNegativeTest-1376032792-project] Returning 404 to user: Volume 3cafa71c-65af-4b00-9348-0ccbae65bbd0 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:52:02.475380 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ae5f4da0-6625-4106-9eec-7af953719403 tempest-VolumesNegativeTest-1376032792 tempest-VolumesNegativeTest-1376032792-project] 10.222.0.82 "DELETE /compute/v2.1/os-volumes/3cafa71c-65af-4b00-9348-0ccbae65bbd0" status: 404 len: 109 microversion: 2.1 time: 1.204329 Aug 24 03:52:02.506862 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 7/7] 10.222.0.82 () {58 vars in 1248 bytes} [Wed Aug 24 03:52:01 2022] DELETE /compute/v2.1/os-volumes/3cafa71c-65af-4b00-9348-0ccbae65bbd0 => generated 109 bytes in 1240 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:52:02.518241 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-47e1f94d-764a-4602-bc40-216db4aaa843 tempest-VolumesNegativeTest-1376032792 tempest-VolumesNegativeTest-1376032792-project] Calling method '.version_select at 0x7f1556099820>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:02.536528 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-6e7d206c-081e-4d19-bb46-b587cb3809ff tempest-VolumesGetTestJSON-881255752 tempest-VolumesGetTestJSON-881255752-project] 10.222.0.82 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.235591 Aug 24 03:52:02.537207 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 1/8] 10.222.0.82 () {60 vars in 1156 bytes} [Wed Aug 24 03:51:59 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3238 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 03:52:02.553393 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-f4a15d52-502d-4164-8300-18eaeb440a5d tempest-VolumesGetTestJSON-881255752 tempest-VolumesGetTestJSON-881255752-project] Calling method '.version_select at 0x7f15560fd4c0>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:02.600296 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-47e1f94d-764a-4602-bc40-216db4aaa843 tempest-VolumesNegativeTest-1376032792 tempest-VolumesNegativeTest-1376032792-project] HTTP exception thrown: Volume ab6b9e69-0794-4e16-a561-cc77bd4034ae could not be found. Aug 24 03:52:02.603449 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-47e1f94d-764a-4602-bc40-216db4aaa843 tempest-VolumesNegativeTest-1376032792 tempest-VolumesNegativeTest-1376032792-project] Request method failure captured: Aug 24 03:52:02.603449 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: request: GET /compute/v2.1/os-volumes/ab6b9e69-0794-4e16-a561-cc77bd4034ae HTTP/1.1 Aug 24 03:52:02.603449 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept: application/json Aug 24 03:52:02.603449 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept-Encoding: identity Aug 24 03:52:02.603449 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Connection: close Aug 24 03:52:02.603449 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Length: 0 Aug 24 03:52:02.603449 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Type: application/json Aug 24 03:52:02.603449 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Host: 10.222.0.82 Aug 24 03:52:02.603449 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Openstack-System-Scope: None Aug 24 03:52:02.603449 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.11 Aug 24 03:52:02.603449 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Auth-Token: gAAAAABjBaBf3WfA0kTP_c0a8sYtBz6drbeynGar4nWr_JOedrY5eERj5m_mutahbEHGWabnG7QqTNfuquFUPFwyT0fU4QQ1XQhFM_40HS0S9_U_7IeN7yrFQ6RB2c1ouP5iDiayxhuRnVasNp2usUIgswuXkkcOBEqO0saOHdB5KUekuqVzbPw Aug 24 03:52:02.603449 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Id: None Aug 24 03:52:02.603449 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Name: None Aug 24 03:52:02.603449 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Identity-Status: Confirmed Aug 24 03:52:02.603449 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Is-Admin-Project: True Aug 24 03:52:02.603449 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Id: default Aug 24 03:52:02.603449 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Name: Default Aug 24 03:52:02.603449 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Id: 798e09b25ee042b49d1df467b70d4fc4 Aug 24 03:52:02.603449 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Name: tempest-VolumesNegativeTest-1376032792 Aug 24 03:52:02.603449 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Role: member,reader Aug 24 03:52:02.603449 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Roles: member,reader Aug 24 03:52:02.604888 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/798e09b25ee042b49d1df467b70d4fc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/798e09b25ee042b49d1df467b70d4fc4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/798e09b25ee042b49d1df467b70d4fc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_798e09b25ee042b49d1df467b70d4fc4", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:52:02.604888 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant: tempest-VolumesNegativeTest-1376032792 Aug 24 03:52:02.604888 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Id: 798e09b25ee042b49d1df467b70d4fc4 Aug 24 03:52:02.604888 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Name: tempest-VolumesNegativeTest-1376032792 Aug 24 03:52:02.604888 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User: tempest-VolumesNegativeTest-1376032792-project Aug 24 03:52:02.604888 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Id: default Aug 24 03:52:02.604888 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Name: Default Aug 24 03:52:02.604888 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Id: 0158925721c1446483b19f9957425732 Aug 24 03:52:02.604888 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Name: tempest-VolumesNegativeTest-1376032792-project Aug 24 03:52:02.604888 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: method: Aug 24 03:52:02.604888 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: exception: Volume ab6b9e69-0794-4e16-a561-cc77bd4034ae could not be found. Aug 24 03:52:02.604888 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: action_args: {'id': 'ab6b9e69-0794-4e16-a561-cc77bd4034ae'} Aug 24 03:52:02.604888 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:52:02.606156 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:02.606156 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:52:02.606156 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:52:02.606156 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:52:02.606156 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:52:02.606156 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:52:02.606156 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:52:02.606156 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:52:02.606156 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:52:02.606156 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:52:02.606156 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:52:02.606156 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:52:02.606156 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:52:02.606156 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:52:02.606156 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:52:02.606156 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ab6b9e69-0794-4e16-a561-cc77bd4034ae could not be found. (HTTP 404) (Request-ID: req-0ab99d1e-aa8c-4ddd-941d-de975406539f) Aug 24 03:52:02.606156 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:52:02.606156 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:52:02.606156 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:52:02.608484 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:02.608484 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 03:52:02.608484 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 03:52:02.608484 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:52:02.608484 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:52:02.608484 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 03:52:02.608484 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 03:52:02.608484 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:52:02.608484 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:52:02.608484 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:52:02.608484 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:52:02.608484 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:52:02.608484 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:52:02.608484 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:52:02.608484 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:52:02.608484 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:52:02.608484 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:52:02.608484 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:52:02.608484 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:52:02.610257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:52:02.610257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:52:02.610257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:52:02.610257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:52:02.610257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ab6b9e69-0794-4e16-a561-cc77bd4034ae could not be found. Aug 24 03:52:02.610257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:52:02.610257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:52:02.610257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:52:02.610257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:02.610257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:52:02.610257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:52:02.610257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:52:02.610257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:52:02.610257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:52:02.610257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:52:02.610257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:52:02.610257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:52:02.610257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 03:52:02.610257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:52:02.612524 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ab6b9e69-0794-4e16-a561-cc77bd4034ae could not be found. Aug 24 03:52:02.612524 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:52:02.612524 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:52:02.612524 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:52:02.612524 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:02.612524 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:52:02.612524 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:52:02.612524 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:52:02.612524 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:52:02.612524 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ab6b9e69-0794-4e16-a561-cc77bd4034ae could not be found. Aug 24 03:52:02.612524 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:52:02.616740 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-47e1f94d-764a-4602-bc40-216db4aaa843 tempest-VolumesNegativeTest-1376032792 tempest-VolumesNegativeTest-1376032792-project] Returning 404 to user: Volume ab6b9e69-0794-4e16-a561-cc77bd4034ae could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:52:02.616740 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-47e1f94d-764a-4602-bc40-216db4aaa843 tempest-VolumesNegativeTest-1376032792 tempest-VolumesNegativeTest-1376032792-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/ab6b9e69-0794-4e16-a561-cc77bd4034ae" status: 404 len: 109 microversion: 2.1 time: 0.101125 Aug 24 03:52:02.617153 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 8/9] 10.222.0.82 () {58 vars in 1245 bytes} [Wed Aug 24 03:52:02 2022] GET /compute/v2.1/os-volumes/ab6b9e69-0794-4e16-a561-cc77bd4034ae => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:52:02.705066 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-f4a15d52-502d-4164-8300-18eaeb440a5d tempest-VolumesGetTestJSON-881255752 tempest-VolumesGetTestJSON-881255752-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/c55095c9-e453-4061-9641-d9b0246e479c" status: 200 len: 353 microversion: 2.1 time: 0.156604 Aug 24 03:52:02.705875 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 2/10] 10.222.0.82 () {58 vars in 1245 bytes} [Wed Aug 24 03:52:02 2022] GET /compute/v2.1/os-volumes/c55095c9-e453-4061-9641-d9b0246e479c => generated 353 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:52:03.721970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c36e2718-988b-41cc-9f05-bde38a208b54 tempest-VolumesGetTestJSON-881255752 tempest-VolumesGetTestJSON-881255752-project] Calling method '.version_select at 0x7f15560e9670>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:03.863048 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c36e2718-988b-41cc-9f05-bde38a208b54 tempest-VolumesGetTestJSON-881255752 tempest-VolumesGetTestJSON-881255752-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/c55095c9-e453-4061-9641-d9b0246e479c" status: 200 len: 353 microversion: 2.1 time: 0.139714 Aug 24 03:52:03.863048 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 9/11] 10.222.0.82 () {58 vars in 1245 bytes} [Wed Aug 24 03:52:03 2022] GET /compute/v2.1/os-volumes/c55095c9-e453-4061-9641-d9b0246e479c => generated 353 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:52:04.874015 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-69c52392-ae65-42b5-b403-3c795e0279ab tempest-VolumesGetTestJSON-881255752 tempest-VolumesGetTestJSON-881255752-project] Calling method '.version_select at 0x7f15560fdb80>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:04.999804 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-69c52392-ae65-42b5-b403-3c795e0279ab tempest-VolumesGetTestJSON-881255752 tempest-VolumesGetTestJSON-881255752-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/c55095c9-e453-4061-9641-d9b0246e479c" status: 200 len: 354 microversion: 2.1 time: 0.132444 Aug 24 03:52:05.006545 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 3/12] 10.222.0.82 () {58 vars in 1245 bytes} [Wed Aug 24 03:52:04 2022] GET /compute/v2.1/os-volumes/c55095c9-e453-4061-9641-d9b0246e479c => generated 354 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:52:05.034305 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-efce465d-54a2-45ce-afc6-4edc6c28d8a9 tempest-VolumesGetTestJSON-881255752 tempest-VolumesGetTestJSON-881255752-project] Calling method '.version_select at 0x7f1556099af0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:05.151662 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-efce465d-54a2-45ce-afc6-4edc6c28d8a9 tempest-VolumesGetTestJSON-881255752 tempest-VolumesGetTestJSON-881255752-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/c55095c9-e453-4061-9641-d9b0246e479c" status: 200 len: 354 microversion: 2.1 time: 0.125232 Aug 24 03:52:05.161513 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 10/13] 10.222.0.82 () {58 vars in 1245 bytes} [Wed Aug 24 03:52:05 2022] GET /compute/v2.1/os-volumes/c55095c9-e453-4061-9641-d9b0246e479c => generated 354 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:52:05.177790 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-c3b154b6-9cb3-4cc2-a52c-bd3f7954b563 tempest-VolumesGetTestJSON-881255752 tempest-VolumesGetTestJSON-881255752-project] Calling method '.version_select at 0x7f1556114280>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:05.590717 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-c3b154b6-9cb3-4cc2-a52c-bd3f7954b563 tempest-VolumesGetTestJSON-881255752 tempest-VolumesGetTestJSON-881255752-project] 10.222.0.82 "DELETE /compute/v2.1/os-volumes/c55095c9-e453-4061-9641-d9b0246e479c" status: 202 len: 0 microversion: 2.1 time: 0.415680 Aug 24 03:52:05.590717 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 4/14] 10.222.0.82 () {58 vars in 1248 bytes} [Wed Aug 24 03:52:05 2022] DELETE /compute/v2.1/os-volumes/c55095c9-e453-4061-9641-d9b0246e479c => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:52:05.612575 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3f817eab-e306-45c0-8c67-d9cfe90f0013 tempest-VolumesGetTestJSON-881255752 tempest-VolumesGetTestJSON-881255752-project] Calling method '.version_select at 0x7f15560998b0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:05.747133 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3f817eab-e306-45c0-8c67-d9cfe90f0013 tempest-VolumesGetTestJSON-881255752 tempest-VolumesGetTestJSON-881255752-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/c55095c9-e453-4061-9641-d9b0246e479c" status: 200 len: 353 microversion: 2.1 time: 0.151165 Aug 24 03:52:05.750271 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 11/15] 10.222.0.82 () {58 vars in 1245 bytes} [Wed Aug 24 03:52:05 2022] GET /compute/v2.1/os-volumes/c55095c9-e453-4061-9641-d9b0246e479c => generated 353 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:52:06.771942 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-239efc71-8e9c-4bd4-8f20-2a27ff8103ab tempest-VolumesGetTestJSON-881255752 tempest-VolumesGetTestJSON-881255752-project] Calling method '.version_select at 0x7f15560fdc10>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:06.828783 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.wsgi [None req-239efc71-8e9c-4bd4-8f20-2a27ff8103ab tempest-VolumesGetTestJSON-881255752 tempest-VolumesGetTestJSON-881255752-project] HTTP exception thrown: Volume c55095c9-e453-4061-9641-d9b0246e479c could not be found. Aug 24 03:52:06.838310 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-239efc71-8e9c-4bd4-8f20-2a27ff8103ab tempest-VolumesGetTestJSON-881255752 tempest-VolumesGetTestJSON-881255752-project] Request method failure captured: Aug 24 03:52:06.838310 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: request: GET /compute/v2.1/os-volumes/c55095c9-e453-4061-9641-d9b0246e479c HTTP/1.1 Aug 24 03:52:06.838310 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept: application/json Aug 24 03:52:06.838310 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept-Encoding: identity Aug 24 03:52:06.838310 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Connection: close Aug 24 03:52:06.838310 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Length: 0 Aug 24 03:52:06.838310 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Type: application/json Aug 24 03:52:06.838310 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Host: 10.222.0.82 Aug 24 03:52:06.838310 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Openstack-System-Scope: None Aug 24 03:52:06.838310 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: User-Agent: python-urllib3/1.26.11 Aug 24 03:52:06.838310 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Auth-Token: gAAAAABjBaBfzcNe9lyKFvRO-TXXoY9D76t8-lyA4yzfHN0xiKSSHj0C3Yb3CHZFtyCElMQxMok7d-F2i-2LVR5bMFZHfSWTV9xVsrqsd_gosuxeIPjWUmTyiljq_KTBdkQus0k9AfTZCmCBR-uGw4M_OcCAuBB1xyUa-xtY7YVf37VhW_AhOVc Aug 24 03:52:06.838310 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Id: None Aug 24 03:52:06.838310 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Name: None Aug 24 03:52:06.838310 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Identity-Status: Confirmed Aug 24 03:52:06.838310 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Is-Admin-Project: True Aug 24 03:52:06.838310 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Id: default Aug 24 03:52:06.838310 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Name: Default Aug 24 03:52:06.838310 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Id: 1015969e512341fc99783bc6dcd472f3 Aug 24 03:52:06.838310 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Name: tempest-VolumesGetTestJSON-881255752 Aug 24 03:52:06.838310 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Role: member,reader Aug 24 03:52:06.838310 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Roles: member,reader Aug 24 03:52:06.839579 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/1015969e512341fc99783bc6dcd472f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/1015969e512341fc99783bc6dcd472f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/1015969e512341fc99783bc6dcd472f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_1015969e512341fc99783bc6dcd472f3", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:52:06.839579 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant: tempest-VolumesGetTestJSON-881255752 Aug 24 03:52:06.839579 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Id: 1015969e512341fc99783bc6dcd472f3 Aug 24 03:52:06.839579 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Name: tempest-VolumesGetTestJSON-881255752 Aug 24 03:52:06.839579 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User: tempest-VolumesGetTestJSON-881255752-project Aug 24 03:52:06.839579 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Id: default Aug 24 03:52:06.839579 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Name: Default Aug 24 03:52:06.839579 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Id: c10d31651ceb45e2940a53b10f034a0a Aug 24 03:52:06.839579 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Name: tempest-VolumesGetTestJSON-881255752-project Aug 24 03:52:06.839579 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: method: Aug 24 03:52:06.839579 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: exception: Volume c55095c9-e453-4061-9641-d9b0246e479c could not be found. Aug 24 03:52:06.839579 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: action_args: {'id': 'c55095c9-e453-4061-9641-d9b0246e479c'} Aug 24 03:52:06.839579 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:52:06.840316 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:06.840316 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:52:06.840316 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:52:06.840316 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:52:06.840316 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:52:06.840316 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:52:06.840316 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:52:06.840316 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:52:06.840316 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:52:06.840316 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:52:06.840316 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:52:06.840316 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:52:06.840316 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:52:06.840316 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:52:06.840316 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:52:06.840316 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c55095c9-e453-4061-9641-d9b0246e479c could not be found. (HTTP 404) (Request-ID: req-f6e1adf4-6a2f-4e20-ad9f-0ed8fd52891e) Aug 24 03:52:06.840316 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:52:06.840316 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:52:06.840316 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:52:06.841627 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:06.841627 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 03:52:06.841627 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 03:52:06.841627 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:52:06.841627 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:52:06.841627 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 03:52:06.841627 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 03:52:06.841627 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:52:06.841627 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:52:06.841627 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:52:06.841627 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:52:06.841627 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:52:06.841627 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:52:06.841627 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:52:06.841627 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:52:06.841627 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:52:06.841627 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:52:06.841627 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:52:06.841627 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:52:06.844332 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:52:06.844332 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:52:06.844332 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:52:06.844332 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:52:06.844332 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c55095c9-e453-4061-9641-d9b0246e479c could not be found. Aug 24 03:52:06.844332 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:52:06.844332 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:52:06.844332 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:52:06.844332 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:06.844332 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:52:06.844332 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:52:06.844332 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:52:06.844332 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:52:06.844332 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:52:06.844332 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:52:06.844332 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:52:06.844332 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:52:06.844332 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 03:52:06.844332 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:52:06.847020 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c55095c9-e453-4061-9641-d9b0246e479c could not be found. Aug 24 03:52:06.847020 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:52:06.847020 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:52:06.847020 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:52:06.847020 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:06.847020 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:52:06.847020 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:52:06.847020 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:52:06.847020 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:52:06.847020 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c55095c9-e453-4061-9641-d9b0246e479c could not be found. Aug 24 03:52:06.847020 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:52:06.847020 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-239efc71-8e9c-4bd4-8f20-2a27ff8103ab tempest-VolumesGetTestJSON-881255752 tempest-VolumesGetTestJSON-881255752-project] Returning 404 to user: Volume c55095c9-e453-4061-9641-d9b0246e479c could not be found. {{(pid=127869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:52:06.876577 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-239efc71-8e9c-4bd4-8f20-2a27ff8103ab tempest-VolumesGetTestJSON-881255752 tempest-VolumesGetTestJSON-881255752-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/c55095c9-e453-4061-9641-d9b0246e479c" status: 404 len: 109 microversion: 2.1 time: 0.086028 Aug 24 03:52:06.876577 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 5/16] 10.222.0.82 () {58 vars in 1245 bytes} [Wed Aug 24 03:52:06 2022] GET /compute/v2.1/os-volumes/c55095c9-e453-4061-9641-d9b0246e479c => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:52:17.238577 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6e72f79c-69b5-46b0-b10f-1883864e93da tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Action: 'create', calling method: .version_select at 0x7f155609e160>, body: {"keypair": {"name": "tempest-keypair-1524783453", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyg3CkTNe3xCScAfWr05hKqKbjsIgd8byEkjNJyEXoOtnEWDxzBsxa9nFQsZCN34ejbCtrAWv6O7hNYtGE6+/nwnN+726BklBpPXTImjJ3pATS5qtaPIWSznmq9b59lgg=="}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:17.380387 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.quota [None req-6e72f79c-69b5-46b0-b10f-1883864e93da tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Getting quotas for project feac5069d37149628113087d9d93912b. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:52:17.398631 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.quota [None req-6e72f79c-69b5-46b0-b10f-1883864e93da tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Getting quotas for user 87a0f4d8b8c341ed85618e70adb2def4 and project feac5069d37149628113087d9d93912b. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:52:17.515506 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-fb440558-3bc5-45d8-934a-cbf7e5d7a117 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1900093021", "imageRef": "c32522f7-22a8-45d4-a51e-f17637def2e1", "flavorRef": "452", "networks": [{"uuid": "4a2b875e-79b2-48db-80dd-a0022627c98a"}]}} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:17.623994 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6e72f79c-69b5-46b0-b10f-1883864e93da tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.036744 Aug 24 03:52:17.625983 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 12/17] 10.222.0.82 () {62 vars in 1200 bytes} [Wed Aug 24 03:52:16 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1039 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 03:52:17.882868 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.network.neutron [None req-fb440558-3bc5-45d8-934a-cbf7e5d7a117 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] validate_networks() for [('4a2b875e-79b2-48db-80dd-a0022627c98a', None, None, None, None, None)] {{(pid=127869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:52:18.231927 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1f84eaa2-f471-46b4-8e99-0981d02ebce0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-709889910", "imageRef": "c32522f7-22a8-45d4-a51e-f17637def2e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:18.486126 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-1f84eaa2-f471-46b4-8e99-0981d02ebce0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] validate_networks() for [('7f2b1e59-498c-4054-b07b-db142e3ad98d', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:52:19.763191 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-fb440558-3bc5-45d8-934a-cbf7e5d7a117 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Flavor limits 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:52:19.763666 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-fb440558-3bc5-45d8-934a-cbf7e5d7a117 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Image limits 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:52:19.769321 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-fb440558-3bc5-45d8-934a-cbf7e5d7a117 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Flavor pref 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:52:19.770203 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-fb440558-3bc5-45d8-934a-cbf7e5d7a117 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Image pref 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:52:19.771180 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-fb440558-3bc5-45d8-934a-cbf7e5d7a117 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:52:19.798819 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-fb440558-3bc5-45d8-934a-cbf7e5d7a117 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:19.800826 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-fb440558-3bc5-45d8-934a-cbf7e5d7a117 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:19.801624 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-fb440558-3bc5-45d8-934a-cbf7e5d7a117 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:19.802413 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-fb440558-3bc5-45d8-934a-cbf7e5d7a117 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:19.804051 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-fb440558-3bc5-45d8-934a-cbf7e5d7a117 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:19.805114 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-fb440558-3bc5-45d8-934a-cbf7e5d7a117 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:19.889187 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.quota [None req-fb440558-3bc5-45d8-934a-cbf7e5d7a117 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Getting quotas for project 649f222d62844debb70df5ed5e8d44ad. Resources: {'instances', 'cores', 'ram'} {{(pid=127869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:52:19.920767 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.quota [None req-fb440558-3bc5-45d8-934a-cbf7e5d7a117 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Getting quotas for user a466f40eba2a4975bd13614474ff527c and project 649f222d62844debb70df5ed5e8d44ad. Resources: {'instances', 'cores', 'ram'} {{(pid=127869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:52:19.945261 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-fb440558-3bc5-45d8-934a-cbf7e5d7a117 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Going to run 1 instances... {{(pid=127869) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:52:19.950239 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-fb440558-3bc5-45d8-934a-cbf7e5d7a117 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] [instance: 0090ef1a-b99b-4032-834a-bfa5d112dfc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c32522f7-22a8-45d4-a51e-f17637def2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:52:20.207337 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-fb440558-3bc5-45d8-934a-cbf7e5d7a117 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.281607 Aug 24 03:52:20.210385 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 6/18] 10.222.0.82 () {60 vars in 1147 bytes} [Wed Aug 24 03:52:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 3285 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:52:21.394845 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-6c36654e-51cb-43ed-a89c-6f7e1989045f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Action: 'create', calling method: .version_select at 0x7f15557860d0>, body: {"keypair": {"name": "tempest-keypair-1981082489", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3HhsRz7ne7WeYp/xOtewEm2M1GAgYlxrLlXQxDYBUro3QkMPi9NbQvpbkbQ1aJitP3BedosPo3lx5wUMTADZpcJoJdxgNEohZirlkFty/SyB/1iELgob+0jOj3LBSinA=="}} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:21.464386 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.quota [None req-6c36654e-51cb-43ed-a89c-6f7e1989045f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Getting quotas for project 46ef5b02d8da4d2eac26b6ccfb35e1a4. Resources: {'key_pairs'} {{(pid=127869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:52:21.474143 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.quota [None req-6c36654e-51cb-43ed-a89c-6f7e1989045f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Getting quotas for user e5582d10ebef459084fe287c18568f98 and project 46ef5b02d8da4d2eac26b6ccfb35e1a4. Resources: {'key_pairs'} {{(pid=127869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:52:21.630086 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-6c36654e-51cb-43ed-a89c-6f7e1989045f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.417176 Aug 24 03:52:21.630818 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 7/19] 10.222.0.82 () {60 vars in 1159 bytes} [Wed Aug 24 03:52:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:52:21.637617 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-1ea03770-e00d-4e51-88af-06aad42a4179 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:21.640822 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-1ea03770-e00d-4e51-88af-06aad42a4179 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] [instance: 0090ef1a-b99b-4032-834a-bfa5d112dfc5] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:21.892760 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-1ea03770-e00d-4e51-88af-06aad42a4179 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466f40eba2a4975bd13614474ff527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649f222d62844debb70df5ed5e8d44ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:21.914418 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-1ea03770-e00d-4e51-88af-06aad42a4179 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] 10.222.0.82 "GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5" status: 200 len: 1215 microversion: 2.1 time: 0.282248 Aug 24 03:52:21.916530 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 8/20] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:21 2022] GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5 => generated 1215 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:21.936206 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-1f84eaa2-f471-46b4-8e99-0981d02ebce0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:52:21.937408 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-1f84eaa2-f471-46b4-8e99-0981d02ebce0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:52:21.938125 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-1f84eaa2-f471-46b4-8e99-0981d02ebce0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:52:21.938795 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-1f84eaa2-f471-46b4-8e99-0981d02ebce0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:52:21.939410 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-1f84eaa2-f471-46b4-8e99-0981d02ebce0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:52:21.963285 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1f84eaa2-f471-46b4-8e99-0981d02ebce0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:21.964158 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1f84eaa2-f471-46b4-8e99-0981d02ebce0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:21.965415 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1f84eaa2-f471-46b4-8e99-0981d02ebce0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:21.967758 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1f84eaa2-f471-46b4-8e99-0981d02ebce0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:21.984348 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1f84eaa2-f471-46b4-8e99-0981d02ebce0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:21.984348 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1f84eaa2-f471-46b4-8e99-0981d02ebce0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:22.043899 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.quota [None req-1f84eaa2-f471-46b4-8e99-0981d02ebce0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Getting quotas for project 63408551e1b24a86b8f0059f1a948896. Resources: {'instances', 'cores', 'ram'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:52:22.064940 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.quota [None req-1f84eaa2-f471-46b4-8e99-0981d02ebce0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Getting quotas for user 547bce0d8133462c95bcb6f272776a27 and project 63408551e1b24a86b8f0059f1a948896. Resources: {'instances', 'cores', 'ram'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:52:22.093967 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1f84eaa2-f471-46b4-8e99-0981d02ebce0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:52:22.100444 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1f84eaa2-f471-46b4-8e99-0981d02ebce0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 13f1df4b-056e-4637-a0ec-54f6f78c8730] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c32522f7-22a8-45d4-a51e-f17637def2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:52:22.210305 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-d1ac1e78-2e74-45f1-a1ac-bb431360b100 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Action: 'create', calling method: .version_select at 0x7f1554729790>, body: {"keypair": {"name": "tempest-keypair-759759468", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBncotjQxTWAwCOJ/YrPIpxQI6RrK9bSyX+iv9DdB9cp9CVAu1Qdtpv1uVGcuBsggAFRz7KZ0+dxEX6Ot20zUaXnjZoHMJ3Xvuc/yzPg5sI8Jbc2K9/XuMR0Vh7LpuoNRg=="}} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:22.248615 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.quota [None req-d1ac1e78-2e74-45f1-a1ac-bb431360b100 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Getting quotas for project bdb802f52e1140d488ff0c6d739cd0d1. Resources: {'key_pairs'} {{(pid=127869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:52:22.260885 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.quota [None req-d1ac1e78-2e74-45f1-a1ac-bb431360b100 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Getting quotas for user c7e29563153a4ecbbe7447bed0324df7 and project bdb802f52e1140d488ff0c6d739cd0d1. Resources: {'key_pairs'} {{(pid=127869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:52:22.389519 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-d1ac1e78-2e74-45f1-a1ac-bb431360b100 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.471459 Aug 24 03:52:22.397541 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 9/21] 10.222.0.82 () {60 vars in 1159 bytes} [Wed Aug 24 03:52:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:52:22.454312 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1f84eaa2-f471-46b4-8e99-0981d02ebce0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.826296 Aug 24 03:52:22.458230 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 13/22] 10.222.0.82 () {60 vars in 1147 bytes} [Wed Aug 24 03:52:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 4832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:52:22.472189 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-667b68ad-8904-4078-8db1-63a6e986798f tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:22.473112 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-667b68ad-8904-4078-8db1-63a6e986798f tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 13f1df4b-056e-4637-a0ec-54f6f78c8730] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:22.563683 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-667b68ad-8904-4078-8db1-63a6e986798f tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:22.576434 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-667b68ad-8904-4078-8db1-63a6e986798f tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730" status: 200 len: 1221 microversion: 2.1 time: 0.107700 Aug 24 03:52:22.577127 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 10/23] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:22 2022] GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730 => generated 1221 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:22.942710 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d71a95b5-6102-4a0f-891c-13d14786755f tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:22.943343 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d71a95b5-6102-4a0f-891c-13d14786755f tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] [instance: 0090ef1a-b99b-4032-834a-bfa5d112dfc5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:22.966887 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-9e10723d-1208-42ae-b46e-18ee9fb840b8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2029001054", "imageRef": "c32522f7-22a8-45d4-a51e-f17637def2e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:23.117905 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.network.neutron [None req-9e10723d-1208-42ae-b46e-18ee9fb840b8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] validate_networks() for [('7f2b1e59-498c-4054-b07b-db142e3ad98d', None, None, None, None, None)] {{(pid=127869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:52:23.242914 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-d71a95b5-6102-4a0f-891c-13d14786755f tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466f40eba2a4975bd13614474ff527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649f222d62844debb70df5ed5e8d44ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:23.277502 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d71a95b5-6102-4a0f-891c-13d14786755f tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] 10.222.0.82 "GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5" status: 200 len: 1215 microversion: 2.1 time: 0.339206 Aug 24 03:52:23.278255 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 14/24] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:22 2022] GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5 => generated 1215 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:24.303224 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-82b445f7-7363-4094-babb-4c3afaf6fa52 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:24.304545 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-82b445f7-7363-4094-babb-4c3afaf6fa52 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] [instance: 0090ef1a-b99b-4032-834a-bfa5d112dfc5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:24.439860 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-82b445f7-7363-4094-babb-4c3afaf6fa52 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466f40eba2a4975bd13614474ff527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649f222d62844debb70df5ed5e8d44ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:24.448268 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-82b445f7-7363-4094-babb-4c3afaf6fa52 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] 10.222.0.82 "GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5" status: 200 len: 1215 microversion: 2.1 time: 0.151649 Aug 24 03:52:24.450132 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-9e10723d-1208-42ae-b46e-18ee9fb840b8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Flavor limits 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:52:24.450630 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-9e10723d-1208-42ae-b46e-18ee9fb840b8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Image limits 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:52:24.451085 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-9e10723d-1208-42ae-b46e-18ee9fb840b8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Flavor pref 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:52:24.451814 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-9e10723d-1208-42ae-b46e-18ee9fb840b8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Image pref 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:52:24.452233 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-9e10723d-1208-42ae-b46e-18ee9fb840b8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:52:24.459075 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 15/25] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:24 2022] GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5 => generated 1215 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:24.496672 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9e10723d-1208-42ae-b46e-18ee9fb840b8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:24.497161 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9e10723d-1208-42ae-b46e-18ee9fb840b8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:24.497595 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9e10723d-1208-42ae-b46e-18ee9fb840b8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:24.498381 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9e10723d-1208-42ae-b46e-18ee9fb840b8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:24.512232 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9e10723d-1208-42ae-b46e-18ee9fb840b8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:24.512723 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9e10723d-1208-42ae-b46e-18ee9fb840b8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:24.593089 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.quota [None req-9e10723d-1208-42ae-b46e-18ee9fb840b8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Getting quotas for project 63408551e1b24a86b8f0059f1a948896. Resources: {'instances', 'cores', 'ram'} {{(pid=127869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:52:24.616486 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.quota [None req-9e10723d-1208-42ae-b46e-18ee9fb840b8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Getting quotas for user 547bce0d8133462c95bcb6f272776a27 and project 63408551e1b24a86b8f0059f1a948896. Resources: {'instances', 'cores', 'ram'} {{(pid=127869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:52:24.663331 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-9e10723d-1208-42ae-b46e-18ee9fb840b8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Going to run 1 instances... {{(pid=127869) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:52:24.668488 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-9e10723d-1208-42ae-b46e-18ee9fb840b8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c32522f7-22a8-45d4-a51e-f17637def2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:52:25.042021 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-9e10723d-1208-42ae-b46e-18ee9fb840b8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.080311 Aug 24 03:52:25.048420 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 11/26] 10.222.0.82 () {60 vars in 1147 bytes} [Wed Aug 24 03:52:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 2088 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:52:25.061286 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-daad45db-e92e-467f-a8e0-27a538247ff9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:25.061909 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-daad45db-e92e-467f-a8e0-27a538247ff9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:25.367409 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-daad45db-e92e-467f-a8e0-27a538247ff9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:25.377372 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-daad45db-e92e-467f-a8e0-27a538247ff9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1222 microversion: 2.1 time: 0.319770 Aug 24 03:52:25.377961 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 16/27] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:25 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1222 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:25.483706 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-42582e0f-f22f-4194-a1d4-7074fc813622 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:25.486014 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-42582e0f-f22f-4194-a1d4-7074fc813622 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] [instance: 0090ef1a-b99b-4032-834a-bfa5d112dfc5] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:25.498277 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-42582e0f-f22f-4194-a1d4-7074fc813622 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:25.499740 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-42582e0f-f22f-4194-a1d4-7074fc813622 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:25.501448 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-42582e0f-f22f-4194-a1d4-7074fc813622 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:25.502452 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-42582e0f-f22f-4194-a1d4-7074fc813622 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:25.503706 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-42582e0f-f22f-4194-a1d4-7074fc813622 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:25.505195 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-42582e0f-f22f-4194-a1d4-7074fc813622 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:25.547370 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-340d06ab-340a-4e40-9f96-a4766b5c139a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1296561165", "imageRef": "c32522f7-22a8-45d4-a51e-f17637def2e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "211e2a76-8131-441d-bb4a-b48c244f355e"}], "security_groups": [{"name": "tempest-securitygroup--553532387"}], "key_name": "tempest-keypair-1524783453", "user_data": "}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:25.902041 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-340d06ab-340a-4e40-9f96-a4766b5c139a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] validate_networks() for [('211e2a76-8131-441d-bb4a-b48c244f355e', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:52:26.072518 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-42582e0f-f22f-4194-a1d4-7074fc813622 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466f40eba2a4975bd13614474ff527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649f222d62844debb70df5ed5e8d44ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:26.102438 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-42582e0f-f22f-4194-a1d4-7074fc813622 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] 10.222.0.82 "GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5" status: 200 len: 1219 microversion: 2.1 time: 0.626178 Aug 24 03:52:26.111250 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 12/28] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:25 2022] GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5 => generated 1219 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:26.401909 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-6e4d5961-bc1f-4bbe-bd32-ab326f2e8157 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:26.402571 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-6e4d5961-bc1f-4bbe-bd32-ab326f2e8157 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:26.573669 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-6e4d5961-bc1f-4bbe-bd32-ab326f2e8157 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:26.593206 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-6e4d5961-bc1f-4bbe-bd32-ab326f2e8157 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1222 microversion: 2.1 time: 0.197101 Aug 24 03:52:26.593826 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 13/29] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:26 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1222 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:26.907152 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-340d06ab-340a-4e40-9f96-a4766b5c139a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:52:26.908955 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-340d06ab-340a-4e40-9f96-a4766b5c139a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:52:26.909540 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-340d06ab-340a-4e40-9f96-a4766b5c139a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:52:26.910840 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-340d06ab-340a-4e40-9f96-a4766b5c139a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:52:26.912324 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-340d06ab-340a-4e40-9f96-a4766b5c139a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:52:26.940849 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-340d06ab-340a-4e40-9f96-a4766b5c139a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:26.941576 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-340d06ab-340a-4e40-9f96-a4766b5c139a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:26.943983 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-340d06ab-340a-4e40-9f96-a4766b5c139a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:26.944925 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-340d06ab-340a-4e40-9f96-a4766b5c139a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:26.952827 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-340d06ab-340a-4e40-9f96-a4766b5c139a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:26.952827 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-340d06ab-340a-4e40-9f96-a4766b5c139a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:27.061586 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.quota [None req-340d06ab-340a-4e40-9f96-a4766b5c139a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Getting quotas for project feac5069d37149628113087d9d93912b. Resources: {'instances', 'cores', 'ram'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:52:27.072360 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.quota [None req-340d06ab-340a-4e40-9f96-a4766b5c139a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Getting quotas for user 87a0f4d8b8c341ed85618e70adb2def4 and project feac5069d37149628113087d9d93912b. Resources: {'instances', 'cores', 'ram'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:52:27.092165 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-340d06ab-340a-4e40-9f96-a4766b5c139a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:52:27.101445 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-340d06ab-340a-4e40-9f96-a4766b5c139a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c32522f7-22a8-45d4-a51e-f17637def2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:52:27.132020 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-b6daa33d-d9a4-4c45-bd53-62fef5cd4fec tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:27.132652 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-b6daa33d-d9a4-4c45-bd53-62fef5cd4fec tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] [instance: 0090ef1a-b99b-4032-834a-bfa5d112dfc5] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:27.141286 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b6daa33d-d9a4-4c45-bd53-62fef5cd4fec tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:27.153838 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b6daa33d-d9a4-4c45-bd53-62fef5cd4fec tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:27.156644 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b6daa33d-d9a4-4c45-bd53-62fef5cd4fec tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:27.160282 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b6daa33d-d9a4-4c45-bd53-62fef5cd4fec tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:27.160504 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b6daa33d-d9a4-4c45-bd53-62fef5cd4fec tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:27.160885 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b6daa33d-d9a4-4c45-bd53-62fef5cd4fec tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:27.321554 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-340d06ab-340a-4e40-9f96-a4766b5c139a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.778621 Aug 24 03:52:27.324249 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 17/30] 10.222.0.82 () {62 vars in 1188 bytes} [Wed Aug 24 03:52:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 1782 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 03:52:27.338715 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2e7e6b34-03ad-4c23-94b3-fa3214e02756 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:27.341259 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2e7e6b34-03ad-4c23-94b3-fa3214e02756 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:27.509111 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-2e7e6b34-03ad-4c23-94b3-fa3214e02756 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:27.520557 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-2e7e6b34-03ad-4c23-94b3-fa3214e02756 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:27.527677 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-2e7e6b34-03ad-4c23-94b3-fa3214e02756 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:27.529435 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2e7e6b34-03ad-4c23-94b3-fa3214e02756 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1282 microversion: 2.20 time: 0.198817 Aug 24 03:52:27.531174 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 18/31] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:27 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1282 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:27.547595 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-b6daa33d-d9a4-4c45-bd53-62fef5cd4fec tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466f40eba2a4975bd13614474ff527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649f222d62844debb70df5ed5e8d44ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:27.558881 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-b6daa33d-d9a4-4c45-bd53-62fef5cd4fec tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] 10.222.0.82 "GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5" status: 200 len: 1267 microversion: 2.1 time: 0.431361 Aug 24 03:52:27.559476 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 14/32] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:27 2022] GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5 => generated 1267 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:27.614563 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-24e62a08-2c6e-4b91-90b2-5e7792c6c192 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:27.615879 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-24e62a08-2c6e-4b91-90b2-5e7792c6c192 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:27.630761 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-24e62a08-2c6e-4b91-90b2-5e7792c6c192 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:27.631281 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-24e62a08-2c6e-4b91-90b2-5e7792c6c192 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:27.631723 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-24e62a08-2c6e-4b91-90b2-5e7792c6c192 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:27.638473 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-24e62a08-2c6e-4b91-90b2-5e7792c6c192 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:27.643569 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-24e62a08-2c6e-4b91-90b2-5e7792c6c192 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:27.646867 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-24e62a08-2c6e-4b91-90b2-5e7792c6c192 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:28.292300 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-24e62a08-2c6e-4b91-90b2-5e7792c6c192 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:28.321770 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-24e62a08-2c6e-4b91-90b2-5e7792c6c192 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1218 microversion: 2.1 time: 0.710608 Aug 24 03:52:28.325329 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 19/33] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:27 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1218 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:28.557749 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-8ec90085-e91c-4c93-aad1-a3804a01539e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:28.558993 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-8ec90085-e91c-4c93-aad1-a3804a01539e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:28.588970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e5e90f24-2356-4652-81fb-15b0d07504a5 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:28.589801 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e5e90f24-2356-4652-81fb-15b0d07504a5 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] [instance: 0090ef1a-b99b-4032-834a-bfa5d112dfc5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:28.608461 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e5e90f24-2356-4652-81fb-15b0d07504a5 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:28.609206 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e5e90f24-2356-4652-81fb-15b0d07504a5 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:28.609858 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e5e90f24-2356-4652-81fb-15b0d07504a5 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:28.611195 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e5e90f24-2356-4652-81fb-15b0d07504a5 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:28.611988 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e5e90f24-2356-4652-81fb-15b0d07504a5 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:28.612633 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e5e90f24-2356-4652-81fb-15b0d07504a5 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:28.776814 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-8ec90085-e91c-4c93-aad1-a3804a01539e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:28.798364 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-e5e90f24-2356-4652-81fb-15b0d07504a5 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466f40eba2a4975bd13614474ff527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649f222d62844debb70df5ed5e8d44ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:28.802763 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-8ec90085-e91c-4c93-aad1-a3804a01539e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:28.813269 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e5e90f24-2356-4652-81fb-15b0d07504a5 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] 10.222.0.82 "GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5" status: 200 len: 1273 microversion: 2.1 time: 0.227214 Aug 24 03:52:28.814849 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 20/34] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:28 2022] GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5 => generated 1273 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:28.830778 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-8ec90085-e91c-4c93-aad1-a3804a01539e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:28.836753 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-8ec90085-e91c-4c93-aad1-a3804a01539e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1282 microversion: 2.20 time: 0.283276 Aug 24 03:52:28.840301 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 15/35] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:28 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1282 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:29.333759 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ed32b838-16e4-4249-8aef-d22f23b4315f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-257839539", "imageRef": "c32522f7-22a8-45d4-a51e-f17637def2e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "79c88d18-c776-4788-a1a0-0200042ca791"}], "security_groups": [{"name": "tempest-securitygroup--167496460"}], "key_name": "tempest-keypair-759759468", "user_data": "}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:29.349150 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-d3096e3d-c153-4d6f-8ae3-a6a739714577 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:29.372368 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-d3096e3d-c153-4d6f-8ae3-a6a739714577 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:29.372368 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d3096e3d-c153-4d6f-8ae3-a6a739714577 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:29.372368 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d3096e3d-c153-4d6f-8ae3-a6a739714577 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:29.372368 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d3096e3d-c153-4d6f-8ae3-a6a739714577 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:29.373852 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d3096e3d-c153-4d6f-8ae3-a6a739714577 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:29.373852 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d3096e3d-c153-4d6f-8ae3-a6a739714577 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:29.373852 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d3096e3d-c153-4d6f-8ae3-a6a739714577 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:29.779258 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-d3096e3d-c153-4d6f-8ae3-a6a739714577 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:29.792791 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-d3096e3d-c153-4d6f-8ae3-a6a739714577 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1282 microversion: 2.1 time: 0.448025 Aug 24 03:52:29.793827 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 16/36] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:29 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1282 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:29.801900 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-1902a8c8-a252-4a08-ad4c-e2bfc98f1efe tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1988753905", "imageRef": "c32522f7-22a8-45d4-a51e-f17637def2e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "35aecb0c-8d69-4fb0-8c17-38cb8c49008a"}], "security_groups": [{"name": "tempest-securitygroup--2114802545"}], "key_name": "tempest-keypair-1981082489", "user_data": "}} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:29.803574 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-ed32b838-16e4-4249-8aef-d22f23b4315f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] validate_networks() for [('79c88d18-c776-4788-a1a0-0200042ca791', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:52:30.198387 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.network.neutron [None req-1902a8c8-a252-4a08-ad4c-e2bfc98f1efe tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] validate_networks() for [('35aecb0c-8d69-4fb0-8c17-38cb8c49008a', None, None, None, None, None)] {{(pid=127869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:52:31.061752 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-ed32b838-16e4-4249-8aef-d22f23b4315f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:52:31.062380 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-ed32b838-16e4-4249-8aef-d22f23b4315f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:52:31.062906 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-ed32b838-16e4-4249-8aef-d22f23b4315f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:52:31.063317 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-ed32b838-16e4-4249-8aef-d22f23b4315f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:52:31.063732 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-ed32b838-16e4-4249-8aef-d22f23b4315f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:52:31.094445 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed32b838-16e4-4249-8aef-d22f23b4315f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:31.095190 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed32b838-16e4-4249-8aef-d22f23b4315f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:31.099365 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed32b838-16e4-4249-8aef-d22f23b4315f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:31.100418 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed32b838-16e4-4249-8aef-d22f23b4315f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:31.111543 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed32b838-16e4-4249-8aef-d22f23b4315f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:31.112257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed32b838-16e4-4249-8aef-d22f23b4315f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:31.185070 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.quota [None req-ed32b838-16e4-4249-8aef-d22f23b4315f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Getting quotas for project bdb802f52e1140d488ff0c6d739cd0d1. Resources: {'instances', 'cores', 'ram'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:52:31.199437 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.quota [None req-ed32b838-16e4-4249-8aef-d22f23b4315f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Getting quotas for user c7e29563153a4ecbbe7447bed0324df7 and project bdb802f52e1140d488ff0c6d739cd0d1. Resources: {'instances', 'cores', 'ram'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:52:31.229364 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ed32b838-16e4-4249-8aef-d22f23b4315f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:52:31.232577 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ed32b838-16e4-4249-8aef-d22f23b4315f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c32522f7-22a8-45d4-a51e-f17637def2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:52:31.441568 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ed32b838-16e4-4249-8aef-d22f23b4315f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.112945 Aug 24 03:52:31.459211 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 21/37] 10.222.0.82 () {60 vars in 1147 bytes} [Wed Aug 24 03:52:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 2131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:52:31.477060 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-76129993-9ea2-4cf5-b31b-65bddd2745ad tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:31.481956 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-76129993-9ea2-4cf5-b31b-65bddd2745ad tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] [instance: 0090ef1a-b99b-4032-834a-bfa5d112dfc5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:31.501716 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76129993-9ea2-4cf5-b31b-65bddd2745ad tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:31.502276 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76129993-9ea2-4cf5-b31b-65bddd2745ad tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:31.502778 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76129993-9ea2-4cf5-b31b-65bddd2745ad tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:31.503769 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76129993-9ea2-4cf5-b31b-65bddd2745ad tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:31.504378 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76129993-9ea2-4cf5-b31b-65bddd2745ad tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:31.504975 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76129993-9ea2-4cf5-b31b-65bddd2745ad tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:32.152117 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-76129993-9ea2-4cf5-b31b-65bddd2745ad tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466f40eba2a4975bd13614474ff527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649f222d62844debb70df5ed5e8d44ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:32.171552 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-76129993-9ea2-4cf5-b31b-65bddd2745ad tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] 10.222.0.82 "GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5" status: 200 len: 1315 microversion: 2.1 time: 0.711058 Aug 24 03:52:32.190633 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 22/38] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:31 2022] GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5 => generated 1315 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:32.208359 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2c924fed-0f35-4aac-8891-b912c22fea53 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:32.209128 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2c924fed-0f35-4aac-8891-b912c22fea53 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:32.220806 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c924fed-0f35-4aac-8891-b912c22fea53 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:32.221300 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c924fed-0f35-4aac-8891-b912c22fea53 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:32.221737 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c924fed-0f35-4aac-8891-b912c22fea53 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:32.222437 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c924fed-0f35-4aac-8891-b912c22fea53 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:32.222919 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c924fed-0f35-4aac-8891-b912c22fea53 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:32.223343 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c924fed-0f35-4aac-8891-b912c22fea53 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:32.392094 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-2c924fed-0f35-4aac-8891-b912c22fea53 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:32.409410 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-2c924fed-0f35-4aac-8891-b912c22fea53 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:32.416408 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-2c924fed-0f35-4aac-8891-b912c22fea53 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:32.417829 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2c924fed-0f35-4aac-8891-b912c22fea53 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1340 microversion: 2.20 time: 0.225820 Aug 24 03:52:32.419384 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 23/39] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:32 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1340 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:32.424800 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bc2bd975-9d8d-426c-9281-a70ff6fda980 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:32.428026 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bc2bd975-9d8d-426c-9281-a70ff6fda980 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:32.478756 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bc2bd975-9d8d-426c-9281-a70ff6fda980 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:32.478756 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bc2bd975-9d8d-426c-9281-a70ff6fda980 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:32.478756 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bc2bd975-9d8d-426c-9281-a70ff6fda980 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:32.478756 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bc2bd975-9d8d-426c-9281-a70ff6fda980 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:32.479353 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bc2bd975-9d8d-426c-9281-a70ff6fda980 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:32.479353 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bc2bd975-9d8d-426c-9281-a70ff6fda980 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:32.787629 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-1902a8c8-a252-4a08-ad4c-e2bfc98f1efe tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Flavor limits 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:52:32.788691 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-1902a8c8-a252-4a08-ad4c-e2bfc98f1efe tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Image limits 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:52:32.789486 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-1902a8c8-a252-4a08-ad4c-e2bfc98f1efe tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Flavor pref 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:52:32.790619 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-1902a8c8-a252-4a08-ad4c-e2bfc98f1efe tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Image pref 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:52:32.791200 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-1902a8c8-a252-4a08-ad4c-e2bfc98f1efe tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:52:32.829317 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1902a8c8-a252-4a08-ad4c-e2bfc98f1efe tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:32.829317 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1902a8c8-a252-4a08-ad4c-e2bfc98f1efe tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:32.831045 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1902a8c8-a252-4a08-ad4c-e2bfc98f1efe tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:32.831731 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1902a8c8-a252-4a08-ad4c-e2bfc98f1efe tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:32.832288 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1902a8c8-a252-4a08-ad4c-e2bfc98f1efe tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:32.832646 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1902a8c8-a252-4a08-ad4c-e2bfc98f1efe tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:32.893297 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.quota [None req-1902a8c8-a252-4a08-ad4c-e2bfc98f1efe tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Getting quotas for project 46ef5b02d8da4d2eac26b6ccfb35e1a4. Resources: {'instances', 'cores', 'ram'} {{(pid=127869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:52:32.900128 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.quota [None req-1902a8c8-a252-4a08-ad4c-e2bfc98f1efe tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Getting quotas for user e5582d10ebef459084fe287c18568f98 and project 46ef5b02d8da4d2eac26b6ccfb35e1a4. Resources: {'instances', 'cores', 'ram'} {{(pid=127869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:52:32.925889 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-1902a8c8-a252-4a08-ad4c-e2bfc98f1efe tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Going to run 1 instances... {{(pid=127869) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:52:32.937753 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-1902a8c8-a252-4a08-ad4c-e2bfc98f1efe tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c32522f7-22a8-45d4-a51e-f17637def2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:52:33.052966 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-bc2bd975-9d8d-426c-9281-a70ff6fda980 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:33.070725 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bc2bd975-9d8d-426c-9281-a70ff6fda980 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1280 microversion: 2.1 time: 0.649679 Aug 24 03:52:33.071474 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 24/40] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:32 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1280 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:33.096437 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c7757c30-65a4-4dab-be9e-f601c9b669c9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:33.098700 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c7757c30-65a4-4dab-be9e-f601c9b669c9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:33.300648 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-c7757c30-65a4-4dab-be9e-f601c9b669c9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:33.310465 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c7757c30-65a4-4dab-be9e-f601c9b669c9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1236 microversion: 2.1 time: 0.237033 Aug 24 03:52:33.313278 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 25/41] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:33 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1236 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:33.317395 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dc4e5ad3-a408-42d0-bd01-33efaa8ca408 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:33.318364 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-dc4e5ad3-a408-42d0-bd01-33efaa8ca408 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] [instance: 0090ef1a-b99b-4032-834a-bfa5d112dfc5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:33.335698 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc4e5ad3-a408-42d0-bd01-33efaa8ca408 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:33.336463 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc4e5ad3-a408-42d0-bd01-33efaa8ca408 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:33.337071 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc4e5ad3-a408-42d0-bd01-33efaa8ca408 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:33.337956 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc4e5ad3-a408-42d0-bd01-33efaa8ca408 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:33.338587 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc4e5ad3-a408-42d0-bd01-33efaa8ca408 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:33.339188 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc4e5ad3-a408-42d0-bd01-33efaa8ca408 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:33.380822 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-1902a8c8-a252-4a08-ad4c-e2bfc98f1efe tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.584102 Aug 24 03:52:33.382052 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 17/42] 10.222.0.82 () {60 vars in 1147 bytes} [Wed Aug 24 03:52:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 3586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:52:33.394419 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-1b8f8289-ea54-4cb0-9509-c26f5cb01994 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:33.395393 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-1b8f8289-ea54-4cb0-9509-c26f5cb01994 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:33.411669 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:33.813034 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-dc4e5ad3-a408-42d0-bd01-33efaa8ca408 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466f40eba2a4975bd13614474ff527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649f222d62844debb70df5ed5e8d44ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:33.838397 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-dc4e5ad3-a408-42d0-bd01-33efaa8ca408 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] 10.222.0.82 "GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5" status: 200 len: 1315 microversion: 2.1 time: 0.525675 Aug 24 03:52:33.840385 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 26/43] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:33 2022] GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5 => generated 1315 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:33.850101 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-1b8f8289-ea54-4cb0-9509-c26f5cb01994 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:33.863490 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-71933a5b-4a8f-4588-a3cb-e5fa6fbefaf1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:33.863490 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-71933a5b-4a8f-4588-a3cb-e5fa6fbefaf1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:33.879328 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71933a5b-4a8f-4588-a3cb-e5fa6fbefaf1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:33.879733 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71933a5b-4a8f-4588-a3cb-e5fa6fbefaf1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:33.880175 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71933a5b-4a8f-4588-a3cb-e5fa6fbefaf1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:33.880920 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71933a5b-4a8f-4588-a3cb-e5fa6fbefaf1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:33.881339 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71933a5b-4a8f-4588-a3cb-e5fa6fbefaf1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:33.882295 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71933a5b-4a8f-4588-a3cb-e5fa6fbefaf1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:33.886033 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-1b8f8289-ea54-4cb0-9509-c26f5cb01994 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b" status: 200 len: 1242 microversion: 2.1 time: 0.495603 Aug 24 03:52:33.887430 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 18/44] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:33 2022] GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b => generated 1242 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:34.094424 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-d4b59178-9794-4c1b-b7e5-4719ecb9ec93 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:34.095180 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-d4b59178-9794-4c1b-b7e5-4719ecb9ec93 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:34.108411 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d4b59178-9794-4c1b-b7e5-4719ecb9ec93 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:34.122130 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d4b59178-9794-4c1b-b7e5-4719ecb9ec93 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:34.125317 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d4b59178-9794-4c1b-b7e5-4719ecb9ec93 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:34.126136 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d4b59178-9794-4c1b-b7e5-4719ecb9ec93 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:34.128492 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d4b59178-9794-4c1b-b7e5-4719ecb9ec93 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:34.130086 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d4b59178-9794-4c1b-b7e5-4719ecb9ec93 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:34.173846 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-71933a5b-4a8f-4588-a3cb-e5fa6fbefaf1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:34.192874 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-71933a5b-4a8f-4588-a3cb-e5fa6fbefaf1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:34.195009 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-71933a5b-4a8f-4588-a3cb-e5fa6fbefaf1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:34.196376 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-71933a5b-4a8f-4588-a3cb-e5fa6fbefaf1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1340 microversion: 2.20 time: 0.353483 Aug 24 03:52:34.199872 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 27/45] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:33 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1340 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:34.334228 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ca9b7e5b-52af-4c60-9366-449ec5a11b3d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:34.339876 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ca9b7e5b-52af-4c60-9366-449ec5a11b3d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:34.362927 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:34.368440 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ca9b7e5b-52af-4c60-9366-449ec5a11b3d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:34.377981 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ca9b7e5b-52af-4c60-9366-449ec5a11b3d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:34.380033 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ca9b7e5b-52af-4c60-9366-449ec5a11b3d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:34.387981 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ca9b7e5b-52af-4c60-9366-449ec5a11b3d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:34.389245 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ca9b7e5b-52af-4c60-9366-449ec5a11b3d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:34.390950 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ca9b7e5b-52af-4c60-9366-449ec5a11b3d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:34.578653 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-ca9b7e5b-52af-4c60-9366-449ec5a11b3d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:34.595568 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ca9b7e5b-52af-4c60-9366-449ec5a11b3d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1240 microversion: 2.1 time: 0.266972 Aug 24 03:52:34.615826 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 28/46] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:34 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1240 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:34.863568 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d329f0f7-6d3e-4388-a997-a922ff0ae6ed tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:34.865436 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d329f0f7-6d3e-4388-a997-a922ff0ae6ed tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] [instance: 0090ef1a-b99b-4032-834a-bfa5d112dfc5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:34.876821 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d329f0f7-6d3e-4388-a997-a922ff0ae6ed tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:34.877384 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d329f0f7-6d3e-4388-a997-a922ff0ae6ed tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:34.877840 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d329f0f7-6d3e-4388-a997-a922ff0ae6ed tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:34.878606 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d329f0f7-6d3e-4388-a997-a922ff0ae6ed tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:34.879071 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d329f0f7-6d3e-4388-a997-a922ff0ae6ed tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:34.894908 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d329f0f7-6d3e-4388-a997-a922ff0ae6ed tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:35.592617 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-d4b59178-9794-4c1b-b7e5-4719ecb9ec93 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:35.602301 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-d4b59178-9794-4c1b-b7e5-4719ecb9ec93 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1322 microversion: 2.1 time: 1.512620 Aug 24 03:52:35.614587 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 19/47] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:34 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1322 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:35.630287 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-3f726d90-ddc9-4fce-839d-c9e796662472 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:35.633603 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-3f726d90-ddc9-4fce-839d-c9e796662472 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:35.700129 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-d329f0f7-6d3e-4388-a997-a922ff0ae6ed tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466f40eba2a4975bd13614474ff527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649f222d62844debb70df5ed5e8d44ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:35.711863 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d329f0f7-6d3e-4388-a997-a922ff0ae6ed tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] 10.222.0.82 "GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5" status: 200 len: 1315 microversion: 2.1 time: 0.852216 Aug 24 03:52:35.717569 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 29/48] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:34 2022] GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5 => generated 1315 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:35.732500 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-39cd93b8-8ff1-4bfc-8dbf-01cc30752b9e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:35.737695 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-39cd93b8-8ff1-4bfc-8dbf-01cc30752b9e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:35.755548 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-39cd93b8-8ff1-4bfc-8dbf-01cc30752b9e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:35.758800 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-39cd93b8-8ff1-4bfc-8dbf-01cc30752b9e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:35.762591 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-39cd93b8-8ff1-4bfc-8dbf-01cc30752b9e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:35.764577 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-39cd93b8-8ff1-4bfc-8dbf-01cc30752b9e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:35.766336 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-39cd93b8-8ff1-4bfc-8dbf-01cc30752b9e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:35.767755 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-39cd93b8-8ff1-4bfc-8dbf-01cc30752b9e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:36.204726 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-39cd93b8-8ff1-4bfc-8dbf-01cc30752b9e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:36.223373 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-39cd93b8-8ff1-4bfc-8dbf-01cc30752b9e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:36.227160 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-39cd93b8-8ff1-4bfc-8dbf-01cc30752b9e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:36.233817 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-39cd93b8-8ff1-4bfc-8dbf-01cc30752b9e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1340 microversion: 2.20 time: 0.513448 Aug 24 03:52:36.236492 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 30/49] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:35 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1340 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:36.299532 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-3f726d90-ddc9-4fce-839d-c9e796662472 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:36.316452 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-3f726d90-ddc9-4fce-839d-c9e796662472 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b" status: 200 len: 1242 microversion: 2.1 time: 0.700389 Aug 24 03:52:36.337121 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 20/50] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:35 2022] GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b => generated 1242 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:36.342396 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-b92e5f12-10ad-4196-97e1-3701a6253b80 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:36.357670 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-b92e5f12-10ad-4196-97e1-3701a6253b80 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:36.380920 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b92e5f12-10ad-4196-97e1-3701a6253b80 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:36.391663 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b92e5f12-10ad-4196-97e1-3701a6253b80 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:36.392392 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b92e5f12-10ad-4196-97e1-3701a6253b80 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:36.393359 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b92e5f12-10ad-4196-97e1-3701a6253b80 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:36.393966 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b92e5f12-10ad-4196-97e1-3701a6253b80 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:36.394868 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b92e5f12-10ad-4196-97e1-3701a6253b80 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:36.547021 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-b92e5f12-10ad-4196-97e1-3701a6253b80 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:36.563093 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-b92e5f12-10ad-4196-97e1-3701a6253b80 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1296 microversion: 2.1 time: 0.224540 Aug 24 03:52:36.569204 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 21/51] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:36 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1296 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:36.633579 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-bc150dbf-5553-4490-839f-8c4918524bcb tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:36.634245 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-bc150dbf-5553-4490-839f-8c4918524bcb tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:36.648504 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bc150dbf-5553-4490-839f-8c4918524bcb tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:36.649004 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bc150dbf-5553-4490-839f-8c4918524bcb tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:36.649457 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bc150dbf-5553-4490-839f-8c4918524bcb tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:36.650147 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bc150dbf-5553-4490-839f-8c4918524bcb tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:36.650623 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bc150dbf-5553-4490-839f-8c4918524bcb tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:36.651043 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bc150dbf-5553-4490-839f-8c4918524bcb tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:36.914195 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-bed21b7c-bf20-446d-9d97-45e39881d814 req-41b30856-25d5-43cb-8797-0096cff80ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13f1df4b-056e-4637-a0ec-54f6f78c8730", "tag": "033aff9c-871d-43e1-8321-7f6d1b63cadb"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:36.944094 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-bed21b7c-bf20-446d-9d97-45e39881d814 req-41b30856-25d5-43cb-8797-0096cff80ba6 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:36.955900 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-bed21b7c-bf20-446d-9d97-45e39881d814 req-41b30856-25d5-43cb-8797-0096cff80ba6 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:36.956659 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-bed21b7c-bf20-446d-9d97-45e39881d814 req-41b30856-25d5-43cb-8797-0096cff80ba6 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:37.016192 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-bed21b7c-bf20-446d-9d97-45e39881d814 req-41b30856-25d5-43cb-8797-0096cff80ba6 service nova] Creating event network-changed:033aff9c-871d-43e1-8321-7f6d1b63cadb for instance 13f1df4b-056e-4637-a0ec-54f6f78c8730 on hv-cinder-85426 Aug 24 03:52:37.016192 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-bed21b7c-bf20-446d-9d97-45e39881d814 req-41b30856-25d5-43cb-8797-0096cff80ba6 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 03:52:37.016192 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-bed21b7c-bf20-446d-9d97-45e39881d814 req-41b30856-25d5-43cb-8797-0096cff80ba6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 03:52:37.018203 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fc7fb158-0b10-46e4-9356-a18c24e5cdc9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:37.021101 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fc7fb158-0b10-46e4-9356-a18c24e5cdc9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:37.021840 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fc7fb158-0b10-46e4-9356-a18c24e5cdc9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:37.022820 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fc7fb158-0b10-46e4-9356-a18c24e5cdc9 None None] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:37.030889 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fc7fb158-0b10-46e4-9356-a18c24e5cdc9 None None] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:37.048649 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fc7fb158-0b10-46e4-9356-a18c24e5cdc9 None None] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:37.051434 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.compute.rpcapi [None req-fc7fb158-0b10-46e4-9356-a18c24e5cdc9 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 03:52:37.054707 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fc7fb158-0b10-46e4-9356-a18c24e5cdc9 None None] Releasing lock "compute-rpcapi-router" {{(pid=127870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 03:52:37.089378 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fc7fb158-0b10-46e4-9356-a18c24e5cdc9 None None] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.849253 Aug 24 03:52:37.090128 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 31/52] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:52:37.098728 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bf64d88b-36d0-405b-9b44-7ab1673318b9 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:37.107152 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bf64d88b-36d0-405b-9b44-7ab1673318b9 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] [instance: 0090ef1a-b99b-4032-834a-bfa5d112dfc5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:37.126096 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf64d88b-36d0-405b-9b44-7ab1673318b9 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:37.127111 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf64d88b-36d0-405b-9b44-7ab1673318b9 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:37.127441 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf64d88b-36d0-405b-9b44-7ab1673318b9 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:37.128170 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf64d88b-36d0-405b-9b44-7ab1673318b9 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:37.128628 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf64d88b-36d0-405b-9b44-7ab1673318b9 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:37.129049 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf64d88b-36d0-405b-9b44-7ab1673318b9 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:37.617012 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-bc150dbf-5553-4490-839f-8c4918524bcb tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:37.660054 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-bc150dbf-5553-4490-839f-8c4918524bcb tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1322 microversion: 2.1 time: 1.025415 Aug 24 03:52:37.662158 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 22/53] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:36 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1322 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:37.671152 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-292dce7e-f695-4394-a00e-13d9788f1fd0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:37.671152 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-292dce7e-f695-4394-a00e-13d9788f1fd0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:37.701538 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-292dce7e-f695-4394-a00e-13d9788f1fd0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:37.701538 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-292dce7e-f695-4394-a00e-13d9788f1fd0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:37.701538 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-292dce7e-f695-4394-a00e-13d9788f1fd0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:37.705177 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-292dce7e-f695-4394-a00e-13d9788f1fd0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:37.705763 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-292dce7e-f695-4394-a00e-13d9788f1fd0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:37.706211 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-292dce7e-f695-4394-a00e-13d9788f1fd0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:37.897885 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-bf64d88b-36d0-405b-9b44-7ab1673318b9 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466f40eba2a4975bd13614474ff527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649f222d62844debb70df5ed5e8d44ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:37.932842 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bf64d88b-36d0-405b-9b44-7ab1673318b9 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] 10.222.0.82 "GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5" status: 200 len: 1315 microversion: 2.1 time: 0.818875 Aug 24 03:52:37.935270 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 32/54] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:37 2022] GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5 => generated 1315 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:37.950416 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a2e6cd20-34dd-4e85-930f-b89623541c2d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:37.951449 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a2e6cd20-34dd-4e85-930f-b89623541c2d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:37.977861 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a2e6cd20-34dd-4e85-930f-b89623541c2d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:37.978883 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a2e6cd20-34dd-4e85-930f-b89623541c2d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:37.979758 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a2e6cd20-34dd-4e85-930f-b89623541c2d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:37.984850 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a2e6cd20-34dd-4e85-930f-b89623541c2d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:37.985698 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a2e6cd20-34dd-4e85-930f-b89623541c2d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:37.986322 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a2e6cd20-34dd-4e85-930f-b89623541c2d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:38.128212 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-a2e6cd20-34dd-4e85-930f-b89623541c2d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:38.148499 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a2e6cd20-34dd-4e85-930f-b89623541c2d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b" status: 200 len: 1294 microversion: 2.1 time: 0.209956 Aug 24 03:52:38.150641 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 33/55] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:37 2022] GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b => generated 1294 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:38.182821 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fe81dc12-a05e-4897-98b1-a68201a8ca40 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:38.185701 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fe81dc12-a05e-4897-98b1-a68201a8ca40 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:38.197794 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe81dc12-a05e-4897-98b1-a68201a8ca40 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:38.198865 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe81dc12-a05e-4897-98b1-a68201a8ca40 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:38.199469 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe81dc12-a05e-4897-98b1-a68201a8ca40 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:38.200332 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe81dc12-a05e-4897-98b1-a68201a8ca40 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:38.201071 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe81dc12-a05e-4897-98b1-a68201a8ca40 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:38.201874 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe81dc12-a05e-4897-98b1-a68201a8ca40 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:38.302100 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-292dce7e-f695-4394-a00e-13d9788f1fd0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:38.323252 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-292dce7e-f695-4394-a00e-13d9788f1fd0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:38.327582 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-292dce7e-f695-4394-a00e-13d9788f1fd0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:38.329019 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-292dce7e-f695-4394-a00e-13d9788f1fd0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1407 microversion: 2.20 time: 0.664824 Aug 24 03:52:38.329686 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 23/56] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:37 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1407 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:38.697815 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-fe81dc12-a05e-4897-98b1-a68201a8ca40 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:38.715144 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fe81dc12-a05e-4897-98b1-a68201a8ca40 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1294 microversion: 2.1 time: 0.559471 Aug 24 03:52:38.716691 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 34/57] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:38 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1294 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:38.726340 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-96a08300-81d6-4605-a23c-1e398c10778c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:38.727300 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-96a08300-81d6-4605-a23c-1e398c10778c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:38.746846 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96a08300-81d6-4605-a23c-1e398c10778c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:38.747786 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-73b71102-6779-4594-99cb-e4dea56d8ef9 req-dff2c82a-1d50-4524-87f0-ca25d51901e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0090ef1a-b99b-4032-834a-bfa5d112dfc5", "tag": "47bc5ad1-6e46-4623-a885-45a6a50611df"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:38.750741 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96a08300-81d6-4605-a23c-1e398c10778c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:38.751391 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96a08300-81d6-4605-a23c-1e398c10778c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:38.752938 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96a08300-81d6-4605-a23c-1e398c10778c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:38.762445 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96a08300-81d6-4605-a23c-1e398c10778c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:38.763024 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96a08300-81d6-4605-a23c-1e398c10778c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:38.836294 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-73b71102-6779-4594-99cb-e4dea56d8ef9 req-dff2c82a-1d50-4524-87f0-ca25d51901e2 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:38.837286 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-73b71102-6779-4594-99cb-e4dea56d8ef9 req-dff2c82a-1d50-4524-87f0-ca25d51901e2 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:38.846393 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-73b71102-6779-4594-99cb-e4dea56d8ef9 req-dff2c82a-1d50-4524-87f0-ca25d51901e2 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:38.937985 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-73b71102-6779-4594-99cb-e4dea56d8ef9 req-dff2c82a-1d50-4524-87f0-ca25d51901e2 service nova] Creating event network-changed:47bc5ad1-6e46-4623-a885-45a6a50611df for instance 0090ef1a-b99b-4032-834a-bfa5d112dfc5 on hv-cinder-85426 Aug 24 03:52:38.948438 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-73b71102-6779-4594-99cb-e4dea56d8ef9 req-dff2c82a-1d50-4524-87f0-ca25d51901e2 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 03:52:38.948438 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-73b71102-6779-4594-99cb-e4dea56d8ef9 req-dff2c82a-1d50-4524-87f0-ca25d51901e2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 03:52:38.948438 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0a9c7c04-62df-448f-aab4-35d6ac37de09 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:38.948438 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0a9c7c04-62df-448f-aab4-35d6ac37de09 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:38.948438 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0a9c7c04-62df-448f-aab4-35d6ac37de09 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:38.948910 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0a9c7c04-62df-448f-aab4-35d6ac37de09 None None] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:38.948910 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0a9c7c04-62df-448f-aab4-35d6ac37de09 None None] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:38.948910 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0a9c7c04-62df-448f-aab4-35d6ac37de09 None None] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:38.958113 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.compute.rpcapi [None req-0a9c7c04-62df-448f-aab4-35d6ac37de09 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 03:52:38.960019 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0a9c7c04-62df-448f-aab4-35d6ac37de09 None None] Releasing lock "compute-rpcapi-router" {{(pid=127869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 03:52:39.042075 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-96a08300-81d6-4605-a23c-1e398c10778c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:39.056638 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-96a08300-81d6-4605-a23c-1e398c10778c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1322 microversion: 2.1 time: 0.338701 Aug 24 03:52:39.057465 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 35/58] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:38 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1322 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:39.076034 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-0a9c7c04-62df-448f-aab4-35d6ac37de09 None None] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.489054 Aug 24 03:52:39.077293 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 24/59] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:52:39.080960 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7ca151bb-2597-45c8-9ecc-948894a671f7 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:39.086130 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7ca151bb-2597-45c8-9ecc-948894a671f7 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] [instance: 0090ef1a-b99b-4032-834a-bfa5d112dfc5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:39.098039 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ca151bb-2597-45c8-9ecc-948894a671f7 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:39.099004 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ca151bb-2597-45c8-9ecc-948894a671f7 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:39.100567 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ca151bb-2597-45c8-9ecc-948894a671f7 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:39.103751 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ca151bb-2597-45c8-9ecc-948894a671f7 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:39.104527 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ca151bb-2597-45c8-9ecc-948894a671f7 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:39.105255 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ca151bb-2597-45c8-9ecc-948894a671f7 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:39.183582 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-3b795c7d-f1f0-4bd0-beea-cce18d3d6fa6 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:39.185131 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-3b795c7d-f1f0-4bd0-beea-cce18d3d6fa6 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:39.215020 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3b795c7d-f1f0-4bd0-beea-cce18d3d6fa6 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:39.215522 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3b795c7d-f1f0-4bd0-beea-cce18d3d6fa6 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:39.215962 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3b795c7d-f1f0-4bd0-beea-cce18d3d6fa6 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:39.216687 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3b795c7d-f1f0-4bd0-beea-cce18d3d6fa6 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:39.219092 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3b795c7d-f1f0-4bd0-beea-cce18d3d6fa6 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:39.219740 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3b795c7d-f1f0-4bd0-beea-cce18d3d6fa6 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:39.546721 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-7ca151bb-2597-45c8-9ecc-948894a671f7 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466f40eba2a4975bd13614474ff527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649f222d62844debb70df5ed5e8d44ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:39.554782 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:39.556242 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-3b795c7d-f1f0-4bd0-beea-cce18d3d6fa6 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:39.562552 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7ca151bb-2597-45c8-9ecc-948894a671f7 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] 10.222.0.82 "GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5" status: 200 len: 1315 microversion: 2.1 time: 0.503463 Aug 24 03:52:39.574214 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-3b795c7d-f1f0-4bd0-beea-cce18d3d6fa6 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b" status: 200 len: 1302 microversion: 2.1 time: 0.399781 Aug 24 03:52:39.575931 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 25/60] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:39 2022] GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b => generated 1302 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:39.585614 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 36/61] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:39 2022] GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5 => generated 1315 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:39.593023 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-11156029-ee29-4a8b-a02d-e2de518e774d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:39.595099 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-11156029-ee29-4a8b-a02d-e2de518e774d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:39.613528 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-11156029-ee29-4a8b-a02d-e2de518e774d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:39.614212 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-11156029-ee29-4a8b-a02d-e2de518e774d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:39.615267 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-11156029-ee29-4a8b-a02d-e2de518e774d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:39.620135 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-11156029-ee29-4a8b-a02d-e2de518e774d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:39.622435 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-11156029-ee29-4a8b-a02d-e2de518e774d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:39.623000 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-11156029-ee29-4a8b-a02d-e2de518e774d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:39.747085 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2ad683a5-9e5c-4468-a3c3-2dcd645edaf9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:39.748476 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2ad683a5-9e5c-4468-a3c3-2dcd645edaf9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:39.757351 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ad683a5-9e5c-4468-a3c3-2dcd645edaf9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:39.758147 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ad683a5-9e5c-4468-a3c3-2dcd645edaf9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:39.758875 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ad683a5-9e5c-4468-a3c3-2dcd645edaf9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:39.759815 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ad683a5-9e5c-4468-a3c3-2dcd645edaf9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:39.760462 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ad683a5-9e5c-4468-a3c3-2dcd645edaf9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:39.761257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ad683a5-9e5c-4468-a3c3-2dcd645edaf9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:39.975663 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-11156029-ee29-4a8b-a02d-e2de518e774d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:40.012796 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-11156029-ee29-4a8b-a02d-e2de518e774d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:40.037453 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-11156029-ee29-4a8b-a02d-e2de518e774d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:40.039053 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-11156029-ee29-4a8b-a02d-e2de518e774d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1407 microversion: 2.20 time: 0.458138 Aug 24 03:52:40.039944 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 26/62] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:39 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1407 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:40.108161 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-74365936-c777-4e2c-a3f8-acc322a7f045 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:40.108161 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-74365936-c777-4e2c-a3f8-acc322a7f045 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:40.113728 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-74365936-c777-4e2c-a3f8-acc322a7f045 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:40.114342 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-74365936-c777-4e2c-a3f8-acc322a7f045 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:40.115717 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-74365936-c777-4e2c-a3f8-acc322a7f045 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:40.116793 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-74365936-c777-4e2c-a3f8-acc322a7f045 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:40.117341 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-74365936-c777-4e2c-a3f8-acc322a7f045 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:40.117772 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-74365936-c777-4e2c-a3f8-acc322a7f045 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:40.581880 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-2ad683a5-9e5c-4468-a3c3-2dcd645edaf9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:40.594263 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2ad683a5-9e5c-4468-a3c3-2dcd645edaf9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1361 microversion: 2.1 time: 0.858459 Aug 24 03:52:40.594885 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 37/63] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:39 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1361 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:40.628330 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6e97b58d-88ae-4c87-96bc-38a423175a77 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:40.628957 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6e97b58d-88ae-4c87-96bc-38a423175a77 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] [instance: 0090ef1a-b99b-4032-834a-bfa5d112dfc5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:40.649192 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e97b58d-88ae-4c87-96bc-38a423175a77 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:40.651943 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e97b58d-88ae-4c87-96bc-38a423175a77 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:40.652517 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e97b58d-88ae-4c87-96bc-38a423175a77 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:40.653395 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e97b58d-88ae-4c87-96bc-38a423175a77 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:40.653855 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e97b58d-88ae-4c87-96bc-38a423175a77 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:40.654279 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e97b58d-88ae-4c87-96bc-38a423175a77 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:41.015809 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-6e97b58d-88ae-4c87-96bc-38a423175a77 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466f40eba2a4975bd13614474ff527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649f222d62844debb70df5ed5e8d44ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:41.030055 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6e97b58d-88ae-4c87-96bc-38a423175a77 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] 10.222.0.82 "GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5" status: 200 len: 1315 microversion: 2.1 time: 0.429939 Aug 24 03:52:41.040239 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 38/64] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:40 2022] GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5 => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:41.056624 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d4a16a2d-b450-4aa1-8bf6-41e4c1ba2a15 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:41.057506 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d4a16a2d-b450-4aa1-8bf6-41e4c1ba2a15 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:41.094592 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d4a16a2d-b450-4aa1-8bf6-41e4c1ba2a15 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:41.097341 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d4a16a2d-b450-4aa1-8bf6-41e4c1ba2a15 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:41.097341 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d4a16a2d-b450-4aa1-8bf6-41e4c1ba2a15 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:41.097341 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d4a16a2d-b450-4aa1-8bf6-41e4c1ba2a15 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:41.097341 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d4a16a2d-b450-4aa1-8bf6-41e4c1ba2a15 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:41.098766 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d4a16a2d-b450-4aa1-8bf6-41e4c1ba2a15 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:41.311408 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-d4a16a2d-b450-4aa1-8bf6-41e4c1ba2a15 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:41.328598 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d4a16a2d-b450-4aa1-8bf6-41e4c1ba2a15 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b" status: 200 len: 1300 microversion: 2.1 time: 0.285091 Aug 24 03:52:41.331591 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 39/65] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:41 2022] GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b => generated 1300 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:41.343406 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-56713ddd-7ccb-488c-9a96-bd35123d3da6 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:41.346073 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-56713ddd-7ccb-488c-9a96-bd35123d3da6 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:41.353566 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-56713ddd-7ccb-488c-9a96-bd35123d3da6 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:41.354284 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-56713ddd-7ccb-488c-9a96-bd35123d3da6 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:41.355128 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-56713ddd-7ccb-488c-9a96-bd35123d3da6 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:41.356017 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-56713ddd-7ccb-488c-9a96-bd35123d3da6 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:41.356672 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-56713ddd-7ccb-488c-9a96-bd35123d3da6 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:41.357271 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-56713ddd-7ccb-488c-9a96-bd35123d3da6 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:41.522406 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-74365936-c777-4e2c-a3f8-acc322a7f045 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:41.545563 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-74365936-c777-4e2c-a3f8-acc322a7f045 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1322 microversion: 2.1 time: 1.467458 Aug 24 03:52:41.559020 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 27/66] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:40 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1322 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:41.564192 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-febf1fad-722e-4b41-89b6-c2c66210076f req-04953bce-bf89-432d-8fea-1aaae3fb198a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b3eb1f1-0fc7-492c-9fba-02f817e5614c", "tag": "ba8506c6-f70f-4108-ae97-aa90b43d1fae"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:41.574816 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-febf1fad-722e-4b41-89b6-c2c66210076f req-04953bce-bf89-432d-8fea-1aaae3fb198a service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:41.575292 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-febf1fad-722e-4b41-89b6-c2c66210076f req-04953bce-bf89-432d-8fea-1aaae3fb198a service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:41.575727 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-febf1fad-722e-4b41-89b6-c2c66210076f req-04953bce-bf89-432d-8fea-1aaae3fb198a service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:41.613967 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-febf1fad-722e-4b41-89b6-c2c66210076f req-04953bce-bf89-432d-8fea-1aaae3fb198a service nova] Creating event network-changed:ba8506c6-f70f-4108-ae97-aa90b43d1fae for instance 9b3eb1f1-0fc7-492c-9fba-02f817e5614c on hv-cinder-85426 Aug 24 03:52:41.619999 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-febf1fad-722e-4b41-89b6-c2c66210076f req-04953bce-bf89-432d-8fea-1aaae3fb198a service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059691 Aug 24 03:52:41.621720 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 28/67] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:52:41.646467 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-03068f52-d664-4f78-a31d-b1047a76d70e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:41.649858 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-03068f52-d664-4f78-a31d-b1047a76d70e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:41.678716 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-03068f52-d664-4f78-a31d-b1047a76d70e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:41.679959 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-03068f52-d664-4f78-a31d-b1047a76d70e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:41.680640 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-03068f52-d664-4f78-a31d-b1047a76d70e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:41.681625 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-03068f52-d664-4f78-a31d-b1047a76d70e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:41.682233 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-03068f52-d664-4f78-a31d-b1047a76d70e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:41.682898 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-03068f52-d664-4f78-a31d-b1047a76d70e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:41.965556 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-56713ddd-7ccb-488c-9a96-bd35123d3da6 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:41.974604 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-56713ddd-7ccb-488c-9a96-bd35123d3da6 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:41.976280 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-56713ddd-7ccb-488c-9a96-bd35123d3da6 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:41.977415 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-56713ddd-7ccb-488c-9a96-bd35123d3da6 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1407 microversion: 2.20 time: 0.643927 Aug 24 03:52:41.977965 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 40/68] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:41 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1407 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:42.065445 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6a6651de-f13c-41b9-b0fa-ad199a724a09 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:42.066110 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6a6651de-f13c-41b9-b0fa-ad199a724a09 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] [instance: 0090ef1a-b99b-4032-834a-bfa5d112dfc5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:42.072510 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a6651de-f13c-41b9-b0fa-ad199a724a09 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:42.074571 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a6651de-f13c-41b9-b0fa-ad199a724a09 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:42.074571 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a6651de-f13c-41b9-b0fa-ad199a724a09 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:42.074571 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a6651de-f13c-41b9-b0fa-ad199a724a09 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:42.086987 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a6651de-f13c-41b9-b0fa-ad199a724a09 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:42.087752 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6a6651de-f13c-41b9-b0fa-ad199a724a09 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:42.141390 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-03068f52-d664-4f78-a31d-b1047a76d70e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:42.152684 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-03068f52-d664-4f78-a31d-b1047a76d70e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1361 microversion: 2.1 time: 0.529454 Aug 24 03:52:42.153581 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 29/69] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:41 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1361 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:42.355941 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-290105cd-380e-4bab-a695-945587b2e379 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:42.359452 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-290105cd-380e-4bab-a695-945587b2e379 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:42.371854 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-290105cd-380e-4bab-a695-945587b2e379 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:42.374686 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-290105cd-380e-4bab-a695-945587b2e379 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:42.374686 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-290105cd-380e-4bab-a695-945587b2e379 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:42.375178 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-290105cd-380e-4bab-a695-945587b2e379 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:42.375967 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-290105cd-380e-4bab-a695-945587b2e379 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:42.376789 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-290105cd-380e-4bab-a695-945587b2e379 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:42.422999 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-6a6651de-f13c-41b9-b0fa-ad199a724a09 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466f40eba2a4975bd13614474ff527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649f222d62844debb70df5ed5e8d44ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:42.434203 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6a6651de-f13c-41b9-b0fa-ad199a724a09 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] 10.222.0.82 "GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5" status: 200 len: 1315 microversion: 2.1 time: 0.371469 Aug 24 03:52:42.434203 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 41/70] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:42 2022] GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5 => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:42.491517 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-290105cd-380e-4bab-a695-945587b2e379 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:42.500430 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-290105cd-380e-4bab-a695-945587b2e379 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b" status: 200 len: 1300 microversion: 2.1 time: 0.149613 Aug 24 03:52:42.509869 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 30/71] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:42 2022] GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b => generated 1300 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:42.576199 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bef593c7-99d5-4d74-84db-36312be1f19e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:42.577163 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bef593c7-99d5-4d74-84db-36312be1f19e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:42.603516 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bef593c7-99d5-4d74-84db-36312be1f19e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:42.604025 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bef593c7-99d5-4d74-84db-36312be1f19e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:42.604468 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bef593c7-99d5-4d74-84db-36312be1f19e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:42.605183 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bef593c7-99d5-4d74-84db-36312be1f19e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:42.605708 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bef593c7-99d5-4d74-84db-36312be1f19e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:42.606135 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bef593c7-99d5-4d74-84db-36312be1f19e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:42.618581 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-33454b6e-f2c9-4c59-9c91-6c802178c764 req-00d29674-f0bf-4faf-b89d-1d53bab6a2ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0aa2d996-08d6-46ce-b978-5de69b34a0f6", "tag": "857c15de-4f2d-494e-a54d-e21ae0588263"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:42.651799 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-33454b6e-f2c9-4c59-9c91-6c802178c764 req-00d29674-f0bf-4faf-b89d-1d53bab6a2ea service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:42.651799 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-33454b6e-f2c9-4c59-9c91-6c802178c764 req-00d29674-f0bf-4faf-b89d-1d53bab6a2ea service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:42.651799 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-33454b6e-f2c9-4c59-9c91-6c802178c764 req-00d29674-f0bf-4faf-b89d-1d53bab6a2ea service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:42.706439 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-33454b6e-f2c9-4c59-9c91-6c802178c764 req-00d29674-f0bf-4faf-b89d-1d53bab6a2ea service nova] Creating event network-changed:857c15de-4f2d-494e-a54d-e21ae0588263 for instance 0aa2d996-08d6-46ce-b978-5de69b34a0f6 on hv-cinder-85426 Aug 24 03:52:42.726042 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-33454b6e-f2c9-4c59-9c91-6c802178c764 req-00d29674-f0bf-4faf-b89d-1d53bab6a2ea service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104717 Aug 24 03:52:42.726042 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 31/72] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:52:43.011510 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-1ceba9b7-777d-4443-983f-54daf848482d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:43.015901 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-1ceba9b7-777d-4443-983f-54daf848482d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:43.028368 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1ceba9b7-777d-4443-983f-54daf848482d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:43.036944 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1ceba9b7-777d-4443-983f-54daf848482d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:43.037765 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1ceba9b7-777d-4443-983f-54daf848482d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:43.038733 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1ceba9b7-777d-4443-983f-54daf848482d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:43.049915 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1ceba9b7-777d-4443-983f-54daf848482d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:43.050463 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1ceba9b7-777d-4443-983f-54daf848482d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:43.306652 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=32 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:43.475389 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-bef593c7-99d5-4d74-84db-36312be1f19e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:43.495127 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bef593c7-99d5-4d74-84db-36312be1f19e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1322 microversion: 2.1 time: 0.930215 Aug 24 03:52:43.498914 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 42/73] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:42 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1322 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:43.507520 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-df0b2134-4327-4751-99a3-b76f5fbcdeb2 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:43.510974 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-df0b2134-4327-4751-99a3-b76f5fbcdeb2 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:43.526939 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-df0b2134-4327-4751-99a3-b76f5fbcdeb2 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:43.527921 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-df0b2134-4327-4751-99a3-b76f5fbcdeb2 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:43.528590 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-df0b2134-4327-4751-99a3-b76f5fbcdeb2 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:43.529523 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-df0b2134-4327-4751-99a3-b76f5fbcdeb2 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:43.530184 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-df0b2134-4327-4751-99a3-b76f5fbcdeb2 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:43.531114 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-df0b2134-4327-4751-99a3-b76f5fbcdeb2 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:44.195999 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-1ceba9b7-777d-4443-983f-54daf848482d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:44.213889 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-1ceba9b7-777d-4443-983f-54daf848482d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:44.216122 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-1ceba9b7-777d-4443-983f-54daf848482d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:44.219336 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-1ceba9b7-777d-4443-983f-54daf848482d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1407 microversion: 2.20 time: 1.218597 Aug 24 03:52:44.220684 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 32/74] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:42 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1407 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:52:44.227596 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-c5e5613d-e558-4a90-9c0d-7d7fd3362819 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:44.229500 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-c5e5613d-e558-4a90-9c0d-7d7fd3362819 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] [instance: 0090ef1a-b99b-4032-834a-bfa5d112dfc5] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:44.248754 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c5e5613d-e558-4a90-9c0d-7d7fd3362819 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:44.249763 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c5e5613d-e558-4a90-9c0d-7d7fd3362819 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:44.250425 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c5e5613d-e558-4a90-9c0d-7d7fd3362819 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:44.251161 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c5e5613d-e558-4a90-9c0d-7d7fd3362819 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:44.251775 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c5e5613d-e558-4a90-9c0d-7d7fd3362819 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:44.256669 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c5e5613d-e558-4a90-9c0d-7d7fd3362819 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:44.271233 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-df0b2134-4327-4751-99a3-b76f5fbcdeb2 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:44.289657 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-df0b2134-4327-4751-99a3-b76f5fbcdeb2 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1361 microversion: 2.1 time: 0.789356 Aug 24 03:52:44.290805 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 43/75] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:43 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1361 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:44.300058 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-13aef0ed-8610-4d66-8bb4-a824e6aa51c0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:44.302398 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-13aef0ed-8610-4d66-8bb4-a824e6aa51c0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:44.311758 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-13aef0ed-8610-4d66-8bb4-a824e6aa51c0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:44.321720 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-13aef0ed-8610-4d66-8bb4-a824e6aa51c0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:44.322196 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-13aef0ed-8610-4d66-8bb4-a824e6aa51c0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:44.322980 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-13aef0ed-8610-4d66-8bb4-a824e6aa51c0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:44.323471 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-13aef0ed-8610-4d66-8bb4-a824e6aa51c0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:44.330202 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-13aef0ed-8610-4d66-8bb4-a824e6aa51c0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:44.658149 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-13aef0ed-8610-4d66-8bb4-a824e6aa51c0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:44.667446 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-13aef0ed-8610-4d66-8bb4-a824e6aa51c0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b" status: 200 len: 1368 microversion: 2.1 time: 0.375308 Aug 24 03:52:44.668022 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 44/76] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:44 2022] GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b => generated 1368 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:44.685080 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-be46df4d-05b9-4a42-afba-12569659644c req-537bb953-f6b0-4976-86d8-49a3f8a9956d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8b22210-7e08-4f01-bf00-d84b0e5e34d7", "tag": "a6ef21fe-e9ce-414a-a115-1f2f2babf6fc"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:44.696639 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-be46df4d-05b9-4a42-afba-12569659644c req-537bb953-f6b0-4976-86d8-49a3f8a9956d service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:44.697345 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-be46df4d-05b9-4a42-afba-12569659644c req-537bb953-f6b0-4976-86d8-49a3f8a9956d service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:44.698179 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-be46df4d-05b9-4a42-afba-12569659644c req-537bb953-f6b0-4976-86d8-49a3f8a9956d service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:44.713632 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-be46df4d-05b9-4a42-afba-12569659644c req-537bb953-f6b0-4976-86d8-49a3f8a9956d service nova] Creating event network-changed:a6ef21fe-e9ce-414a-a115-1f2f2babf6fc for instance b8b22210-7e08-4f01-bf00-d84b0e5e34d7 on hv-cinder-85426 Aug 24 03:52:44.718427 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-be46df4d-05b9-4a42-afba-12569659644c req-537bb953-f6b0-4976-86d8-49a3f8a9956d service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049072 Aug 24 03:52:44.719074 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 45/77] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:52:44.725701 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e2a545f8-b03f-4e25-b27a-321daf1d85f5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:44.726400 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e2a545f8-b03f-4e25-b27a-321daf1d85f5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:44.732584 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e2a545f8-b03f-4e25-b27a-321daf1d85f5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:44.733568 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e2a545f8-b03f-4e25-b27a-321daf1d85f5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:44.734023 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e2a545f8-b03f-4e25-b27a-321daf1d85f5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:44.734751 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e2a545f8-b03f-4e25-b27a-321daf1d85f5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:44.734877 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-c5e5613d-e558-4a90-9c0d-7d7fd3362819 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466f40eba2a4975bd13614474ff527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649f222d62844debb70df5ed5e8d44ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:44.735487 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e2a545f8-b03f-4e25-b27a-321daf1d85f5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:44.736073 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e2a545f8-b03f-4e25-b27a-321daf1d85f5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:44.743505 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-c5e5613d-e558-4a90-9c0d-7d7fd3362819 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] 10.222.0.82 "GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5" status: 200 len: 1315 microversion: 2.1 time: 0.521222 Aug 24 03:52:44.754109 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 33/78] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:44 2022] GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5 => generated 1315 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:44.887169 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-e2a545f8-b03f-4e25-b27a-321daf1d85f5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:44.896171 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e2a545f8-b03f-4e25-b27a-321daf1d85f5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1322 microversion: 2.1 time: 0.174772 Aug 24 03:52:44.896756 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 46/79] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:44 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:45.258297 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-f721fc9a-23a1-49ef-8938-899c21461c1a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:45.258964 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-f721fc9a-23a1-49ef-8938-899c21461c1a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:45.275081 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f721fc9a-23a1-49ef-8938-899c21461c1a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:45.275492 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f721fc9a-23a1-49ef-8938-899c21461c1a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:45.275932 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f721fc9a-23a1-49ef-8938-899c21461c1a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:45.276795 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f721fc9a-23a1-49ef-8938-899c21461c1a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:45.277255 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f721fc9a-23a1-49ef-8938-899c21461c1a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:45.277680 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f721fc9a-23a1-49ef-8938-899c21461c1a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:45.299601 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell1:SELECT=100 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:45.315633 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-de3cd338-3a6d-4b7b-bb39-606cb6814460 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:45.317950 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-de3cd338-3a6d-4b7b-bb39-606cb6814460 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:45.327275 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-de3cd338-3a6d-4b7b-bb39-606cb6814460 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:45.328038 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-de3cd338-3a6d-4b7b-bb39-606cb6814460 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:45.328692 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-de3cd338-3a6d-4b7b-bb39-606cb6814460 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:45.329519 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-de3cd338-3a6d-4b7b-bb39-606cb6814460 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:45.330305 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-de3cd338-3a6d-4b7b-bb39-606cb6814460 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:45.330899 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-de3cd338-3a6d-4b7b-bb39-606cb6814460 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:45.422093 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-f721fc9a-23a1-49ef-8938-899c21461c1a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:45.430854 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-f721fc9a-23a1-49ef-8938-899c21461c1a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:45.432349 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-f721fc9a-23a1-49ef-8938-899c21461c1a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:45.433440 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-f721fc9a-23a1-49ef-8938-899c21461c1a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1407 microversion: 2.20 time: 0.181255 Aug 24 03:52:45.434001 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 34/80] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:45 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:45.471643 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-de3cd338-3a6d-4b7b-bb39-606cb6814460 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:45.479849 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-de3cd338-3a6d-4b7b-bb39-606cb6814460 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1361 microversion: 2.1 time: 0.169531 Aug 24 03:52:45.480693 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 47/81] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:45 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:45.688351 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-395b7e35-e4d7-4887-8708-e8ac85c58bf2 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:45.688963 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-395b7e35-e4d7-4887-8708-e8ac85c58bf2 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:45.695736 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-395b7e35-e4d7-4887-8708-e8ac85c58bf2 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:45.698013 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-395b7e35-e4d7-4887-8708-e8ac85c58bf2 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:45.698013 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-395b7e35-e4d7-4887-8708-e8ac85c58bf2 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:45.698013 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-395b7e35-e4d7-4887-8708-e8ac85c58bf2 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:45.698013 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-395b7e35-e4d7-4887-8708-e8ac85c58bf2 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:45.698352 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-395b7e35-e4d7-4887-8708-e8ac85c58bf2 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:45.765051 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e59d7fa1-c2cb-4940-8132-ca142930e8dd tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:45.765923 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e59d7fa1-c2cb-4940-8132-ca142930e8dd tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] [instance: 0090ef1a-b99b-4032-834a-bfa5d112dfc5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:45.773470 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e59d7fa1-c2cb-4940-8132-ca142930e8dd tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:45.774215 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e59d7fa1-c2cb-4940-8132-ca142930e8dd tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:45.774955 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e59d7fa1-c2cb-4940-8132-ca142930e8dd tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:45.775652 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e59d7fa1-c2cb-4940-8132-ca142930e8dd tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:45.776108 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e59d7fa1-c2cb-4940-8132-ca142930e8dd tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:45.776713 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e59d7fa1-c2cb-4940-8132-ca142930e8dd tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:45.844367 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-395b7e35-e4d7-4887-8708-e8ac85c58bf2 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:45.853020 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-395b7e35-e4d7-4887-8708-e8ac85c58bf2 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b" status: 200 len: 1368 microversion: 2.1 time: 0.168273 Aug 24 03:52:45.858648 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 35/82] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:45 2022] GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:45.918234 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-c1f284d9-4afd-46fe-9151-d8b06a89cd73 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:45.919100 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-c1f284d9-4afd-46fe-9151-d8b06a89cd73 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:45.926483 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c1f284d9-4afd-46fe-9151-d8b06a89cd73 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:45.927737 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c1f284d9-4afd-46fe-9151-d8b06a89cd73 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:45.928399 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c1f284d9-4afd-46fe-9151-d8b06a89cd73 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:45.929314 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c1f284d9-4afd-46fe-9151-d8b06a89cd73 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:45.929985 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c1f284d9-4afd-46fe-9151-d8b06a89cd73 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:45.930635 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c1f284d9-4afd-46fe-9151-d8b06a89cd73 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:45.975854 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-e59d7fa1-c2cb-4940-8132-ca142930e8dd tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466f40eba2a4975bd13614474ff527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649f222d62844debb70df5ed5e8d44ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:45.985522 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e59d7fa1-c2cb-4940-8132-ca142930e8dd tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] 10.222.0.82 "GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5" status: 200 len: 1315 microversion: 2.1 time: 0.224630 Aug 24 03:52:46.007455 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 48/83] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:45 2022] GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:46.099230 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-c1f284d9-4afd-46fe-9151-d8b06a89cd73 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:46.106868 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-c1f284d9-4afd-46fe-9151-d8b06a89cd73 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1322 microversion: 2.1 time: 0.193441 Aug 24 03:52:46.107429 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 36/84] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:45 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:46.457437 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4db65c72-b022-44a9-bb9b-92b47628bc81 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:46.457989 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4db65c72-b022-44a9-bb9b-92b47628bc81 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:46.464009 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4db65c72-b022-44a9-bb9b-92b47628bc81 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:46.464489 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4db65c72-b022-44a9-bb9b-92b47628bc81 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:46.464926 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4db65c72-b022-44a9-bb9b-92b47628bc81 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:46.465614 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4db65c72-b022-44a9-bb9b-92b47628bc81 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:46.466063 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4db65c72-b022-44a9-bb9b-92b47628bc81 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:46.466482 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4db65c72-b022-44a9-bb9b-92b47628bc81 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:46.501278 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-c7708f17-eb26-47c3-be0b-5f1a36e9650c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:46.501884 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-c7708f17-eb26-47c3-be0b-5f1a36e9650c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:46.505566 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell0:SELECT=38 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:46.509191 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c7708f17-eb26-47c3-be0b-5f1a36e9650c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:46.509834 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c7708f17-eb26-47c3-be0b-5f1a36e9650c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:46.514418 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c7708f17-eb26-47c3-be0b-5f1a36e9650c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:46.514418 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c7708f17-eb26-47c3-be0b-5f1a36e9650c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:46.514418 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c7708f17-eb26-47c3-be0b-5f1a36e9650c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:46.514418 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c7708f17-eb26-47c3-be0b-5f1a36e9650c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:46.605751 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-4db65c72-b022-44a9-bb9b-92b47628bc81 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:46.615505 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-4db65c72-b022-44a9-bb9b-92b47628bc81 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:46.616899 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-4db65c72-b022-44a9-bb9b-92b47628bc81 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:46.618015 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4db65c72-b022-44a9-bb9b-92b47628bc81 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1407 microversion: 2.20 time: 0.164643 Aug 24 03:52:46.618956 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 49/85] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:46 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:46.659309 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-c7708f17-eb26-47c3-be0b-5f1a36e9650c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:46.663240 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-c7708f17-eb26-47c3-be0b-5f1a36e9650c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1361 microversion: 2.1 time: 0.166280 Aug 24 03:52:46.663899 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 37/86] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:46 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:46.734410 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-e2f6e2e1-e0c4-4353-81c1-0a9b0154bcef req-1f4834e5-4590-41d9-9aef-5ff7491b5821 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd0bdd49-e4b5-4819-91f5-399d77f4dd4b", "tag": "b3a05365-20ef-4b17-b002-533b96739ce0"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:46.744134 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-e2f6e2e1-e0c4-4353-81c1-0a9b0154bcef req-1f4834e5-4590-41d9-9aef-5ff7491b5821 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:46.744693 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-e2f6e2e1-e0c4-4353-81c1-0a9b0154bcef req-1f4834e5-4590-41d9-9aef-5ff7491b5821 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:46.745187 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-e2f6e2e1-e0c4-4353-81c1-0a9b0154bcef req-1f4834e5-4590-41d9-9aef-5ff7491b5821 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:46.756677 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-e2f6e2e1-e0c4-4353-81c1-0a9b0154bcef req-1f4834e5-4590-41d9-9aef-5ff7491b5821 service nova] Creating event network-changed:b3a05365-20ef-4b17-b002-533b96739ce0 for instance dd0bdd49-e4b5-4819-91f5-399d77f4dd4b on hv-cinder-85426 Aug 24 03:52:46.762230 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-e2f6e2e1-e0c4-4353-81c1-0a9b0154bcef req-1f4834e5-4590-41d9-9aef-5ff7491b5821 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031162 Aug 24 03:52:46.762702 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 50/87] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:52:46.873879 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-7393efb5-d2c8-4681-aeca-fc341383094f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:46.874478 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-7393efb5-d2c8-4681-aeca-fc341383094f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:46.881150 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7393efb5-d2c8-4681-aeca-fc341383094f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:46.881644 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7393efb5-d2c8-4681-aeca-fc341383094f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:46.882069 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7393efb5-d2c8-4681-aeca-fc341383094f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:46.882777 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7393efb5-d2c8-4681-aeca-fc341383094f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:46.883223 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7393efb5-d2c8-4681-aeca-fc341383094f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:46.883643 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7393efb5-d2c8-4681-aeca-fc341383094f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:47.017825 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d3b605e7-8c91-4e24-aee4-ccbba534b99d tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:47.018818 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d3b605e7-8c91-4e24-aee4-ccbba534b99d tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] [instance: 0090ef1a-b99b-4032-834a-bfa5d112dfc5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:47.023413 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-7393efb5-d2c8-4681-aeca-fc341383094f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:47.026716 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d3b605e7-8c91-4e24-aee4-ccbba534b99d tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:47.027453 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d3b605e7-8c91-4e24-aee4-ccbba534b99d tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:47.027993 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d3b605e7-8c91-4e24-aee4-ccbba534b99d tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:47.028944 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d3b605e7-8c91-4e24-aee4-ccbba534b99d tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:47.029709 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d3b605e7-8c91-4e24-aee4-ccbba534b99d tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:47.030160 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d3b605e7-8c91-4e24-aee4-ccbba534b99d tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:47.032503 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-7393efb5-d2c8-4681-aeca-fc341383094f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b" status: 200 len: 1368 microversion: 2.1 time: 0.162556 Aug 24 03:52:47.033386 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 38/88] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:46 2022] GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:47.048227 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=8 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:47.128344 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-974d70c1-588b-451b-87a0-285283b52256 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:47.129838 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-974d70c1-588b-451b-87a0-285283b52256 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:47.136227 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-974d70c1-588b-451b-87a0-285283b52256 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:47.136924 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-974d70c1-588b-451b-87a0-285283b52256 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:47.137566 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-974d70c1-588b-451b-87a0-285283b52256 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:47.138525 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-974d70c1-588b-451b-87a0-285283b52256 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:47.138984 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-974d70c1-588b-451b-87a0-285283b52256 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:47.139411 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-974d70c1-588b-451b-87a0-285283b52256 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:47.182162 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-d3b605e7-8c91-4e24-aee4-ccbba534b99d tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466f40eba2a4975bd13614474ff527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649f222d62844debb70df5ed5e8d44ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:47.190752 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d3b605e7-8c91-4e24-aee4-ccbba534b99d tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] 10.222.0.82 "GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5" status: 200 len: 1315 microversion: 2.1 time: 0.177103 Aug 24 03:52:47.198313 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 51/89] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:47 2022] GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:47.309572 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-974d70c1-588b-451b-87a0-285283b52256 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:47.317306 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-974d70c1-588b-451b-87a0-285283b52256 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1322 microversion: 2.1 time: 0.193172 Aug 24 03:52:47.317883 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 39/90] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:47 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:47.640760 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a3f4c063-174e-493f-9edd-5bb08072fef8 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:47.641417 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a3f4c063-174e-493f-9edd-5bb08072fef8 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:47.647360 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a3f4c063-174e-493f-9edd-5bb08072fef8 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:47.652671 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a3f4c063-174e-493f-9edd-5bb08072fef8 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:47.652671 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a3f4c063-174e-493f-9edd-5bb08072fef8 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:47.652671 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a3f4c063-174e-493f-9edd-5bb08072fef8 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:47.652671 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a3f4c063-174e-493f-9edd-5bb08072fef8 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:47.653016 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a3f4c063-174e-493f-9edd-5bb08072fef8 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:47.684673 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-1af0dabd-8e0f-4590-b7aa-c5fb8272d3e9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:47.685366 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-1af0dabd-8e0f-4590-b7aa-c5fb8272d3e9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:47.693705 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1af0dabd-8e0f-4590-b7aa-c5fb8272d3e9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:47.694297 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1af0dabd-8e0f-4590-b7aa-c5fb8272d3e9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:47.694826 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1af0dabd-8e0f-4590-b7aa-c5fb8272d3e9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:47.695612 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1af0dabd-8e0f-4590-b7aa-c5fb8272d3e9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:47.696136 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1af0dabd-8e0f-4590-b7aa-c5fb8272d3e9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:47.696620 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1af0dabd-8e0f-4590-b7aa-c5fb8272d3e9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:47.959816 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-1af0dabd-8e0f-4590-b7aa-c5fb8272d3e9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:47.971059 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-1af0dabd-8e0f-4590-b7aa-c5fb8272d3e9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1361 microversion: 2.1 time: 0.289725 Aug 24 03:52:47.996143 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 40/91] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:47 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1361 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:47.999696 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-a3f4c063-174e-493f-9edd-5bb08072fef8 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:48.009821 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-a3f4c063-174e-493f-9edd-5bb08072fef8 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:48.011376 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-a3f4c063-174e-493f-9edd-5bb08072fef8 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:48.012504 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a3f4c063-174e-493f-9edd-5bb08072fef8 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1407 microversion: 2.20 time: 0.375588 Aug 24 03:52:48.013062 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 52/92] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:47 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1407 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:48.054729 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-222e829d-2ccf-4331-a94a-fcf2f29a4ca7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:48.055412 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-222e829d-2ccf-4331-a94a-fcf2f29a4ca7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:48.061386 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-222e829d-2ccf-4331-a94a-fcf2f29a4ca7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:48.061861 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-222e829d-2ccf-4331-a94a-fcf2f29a4ca7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:48.062288 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-222e829d-2ccf-4331-a94a-fcf2f29a4ca7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:48.063011 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-222e829d-2ccf-4331-a94a-fcf2f29a4ca7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:48.063443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-222e829d-2ccf-4331-a94a-fcf2f29a4ca7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:48.063852 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-222e829d-2ccf-4331-a94a-fcf2f29a4ca7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:48.210759 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-222e829d-2ccf-4331-a94a-fcf2f29a4ca7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:48.213466 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-04e3d9dd-8657-43df-a055-62ef5be31fa0 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:48.214269 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-04e3d9dd-8657-43df-a055-62ef5be31fa0 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] [instance: 0090ef1a-b99b-4032-834a-bfa5d112dfc5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:48.218776 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-222e829d-2ccf-4331-a94a-fcf2f29a4ca7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b" status: 200 len: 1368 microversion: 2.1 time: 0.169076 Aug 24 03:52:48.220592 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-04e3d9dd-8657-43df-a055-62ef5be31fa0 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:48.221275 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-04e3d9dd-8657-43df-a055-62ef5be31fa0 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:48.221766 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-04e3d9dd-8657-43df-a055-62ef5be31fa0 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:48.222661 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-04e3d9dd-8657-43df-a055-62ef5be31fa0 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:48.223120 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-04e3d9dd-8657-43df-a055-62ef5be31fa0 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:48.223654 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-04e3d9dd-8657-43df-a055-62ef5be31fa0 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:48.223977 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 41/93] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:48 2022] GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:48.337953 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-65f27bb3-6f99-4939-82e8-0d6776f9318b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:48.338593 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-65f27bb3-6f99-4939-82e8-0d6776f9318b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:48.344939 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-65f27bb3-6f99-4939-82e8-0d6776f9318b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:48.345470 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-65f27bb3-6f99-4939-82e8-0d6776f9318b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:48.345904 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-65f27bb3-6f99-4939-82e8-0d6776f9318b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:48.346625 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-65f27bb3-6f99-4939-82e8-0d6776f9318b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:48.347076 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-65f27bb3-6f99-4939-82e8-0d6776f9318b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:48.348123 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-65f27bb3-6f99-4939-82e8-0d6776f9318b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:48.370598 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-04e3d9dd-8657-43df-a055-62ef5be31fa0 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466f40eba2a4975bd13614474ff527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649f222d62844debb70df5ed5e8d44ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:48.378884 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-04e3d9dd-8657-43df-a055-62ef5be31fa0 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] 10.222.0.82 "GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5" status: 200 len: 1315 microversion: 2.1 time: 0.169284 Aug 24 03:52:48.380935 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 53/94] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:48 2022] GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:48.500648 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-65f27bb3-6f99-4939-82e8-0d6776f9318b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:48.513917 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-65f27bb3-6f99-4939-82e8-0d6776f9318b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1322 microversion: 2.1 time: 0.179728 Aug 24 03:52:48.514525 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 42/95] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:48 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:49.004952 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a31170a0-4e83-4756-a3f0-6542d7231f47 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:49.005596 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a31170a0-4e83-4756-a3f0-6542d7231f47 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:49.018106 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a31170a0-4e83-4756-a3f0-6542d7231f47 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:49.018892 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a31170a0-4e83-4756-a3f0-6542d7231f47 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:49.020271 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a31170a0-4e83-4756-a3f0-6542d7231f47 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:49.021204 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a31170a0-4e83-4756-a3f0-6542d7231f47 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:49.023683 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a31170a0-4e83-4756-a3f0-6542d7231f47 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:49.024284 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a31170a0-4e83-4756-a3f0-6542d7231f47 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:49.038716 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-ad75ce04-2304-49e3-874b-1f97b111bc46 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:49.039375 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-ad75ce04-2304-49e3-874b-1f97b111bc46 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:49.049090 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell0:SELECT=8 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:49.050664 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ad75ce04-2304-49e3-874b-1f97b111bc46 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:49.054116 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ad75ce04-2304-49e3-874b-1f97b111bc46 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:49.054592 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ad75ce04-2304-49e3-874b-1f97b111bc46 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:49.055320 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ad75ce04-2304-49e3-874b-1f97b111bc46 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:49.055769 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ad75ce04-2304-49e3-874b-1f97b111bc46 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:49.056184 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ad75ce04-2304-49e3-874b-1f97b111bc46 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:49.197232 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-a31170a0-4e83-4756-a3f0-6542d7231f47 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:49.200831 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:49.205387 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a31170a0-4e83-4756-a3f0-6542d7231f47 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1361 microversion: 2.1 time: 0.205446 Aug 24 03:52:49.205957 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 54/96] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:48 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1361 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:49.217960 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-ad75ce04-2304-49e3-874b-1f97b111bc46 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:49.227162 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-ad75ce04-2304-49e3-874b-1f97b111bc46 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:49.228733 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-ad75ce04-2304-49e3-874b-1f97b111bc46 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:49.229902 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-ad75ce04-2304-49e3-874b-1f97b111bc46 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1407 microversion: 2.20 time: 0.197895 Aug 24 03:52:49.230452 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 43/97] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:49 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:49.248330 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8e516f91-a64a-4367-af65-9c1d2bb43ce0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:49.248944 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8e516f91-a64a-4367-af65-9c1d2bb43ce0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:49.256198 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8e516f91-a64a-4367-af65-9c1d2bb43ce0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:49.256859 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8e516f91-a64a-4367-af65-9c1d2bb43ce0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:49.257298 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8e516f91-a64a-4367-af65-9c1d2bb43ce0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:49.258293 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8e516f91-a64a-4367-af65-9c1d2bb43ce0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:49.258848 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8e516f91-a64a-4367-af65-9c1d2bb43ce0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:49.259356 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8e516f91-a64a-4367-af65-9c1d2bb43ce0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:49.401372 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-8e516f91-a64a-4367-af65-9c1d2bb43ce0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:49.401798 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-a1450e7e-2ed9-4362-9cce-e42c1a4d34d2 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:49.402442 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-a1450e7e-2ed9-4362-9cce-e42c1a4d34d2 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] [instance: 0090ef1a-b99b-4032-834a-bfa5d112dfc5] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:49.408635 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a1450e7e-2ed9-4362-9cce-e42c1a4d34d2 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:49.409113 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a1450e7e-2ed9-4362-9cce-e42c1a4d34d2 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:49.409551 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a1450e7e-2ed9-4362-9cce-e42c1a4d34d2 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:49.409717 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8e516f91-a64a-4367-af65-9c1d2bb43ce0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b" status: 200 len: 1368 microversion: 2.1 time: 0.165124 Aug 24 03:52:49.410475 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 55/98] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:49 2022] GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:49.411011 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a1450e7e-2ed9-4362-9cce-e42c1a4d34d2 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:49.411556 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a1450e7e-2ed9-4362-9cce-e42c1a4d34d2 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:49.411983 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a1450e7e-2ed9-4362-9cce-e42c1a4d34d2 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:49.539801 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-70662bad-a847-4ab6-98a7-ba6fca46039a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:49.540431 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-70662bad-a847-4ab6-98a7-ba6fca46039a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:49.545233 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-a1450e7e-2ed9-4362-9cce-e42c1a4d34d2 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466f40eba2a4975bd13614474ff527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649f222d62844debb70df5ed5e8d44ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:49.546756 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-70662bad-a847-4ab6-98a7-ba6fca46039a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:49.547313 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-70662bad-a847-4ab6-98a7-ba6fca46039a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:49.547814 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-70662bad-a847-4ab6-98a7-ba6fca46039a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:49.548571 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-70662bad-a847-4ab6-98a7-ba6fca46039a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:49.549099 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-70662bad-a847-4ab6-98a7-ba6fca46039a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:49.549629 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-70662bad-a847-4ab6-98a7-ba6fca46039a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:49.554986 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-a1450e7e-2ed9-4362-9cce-e42c1a4d34d2 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] 10.222.0.82 "GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5" status: 200 len: 1315 microversion: 2.1 time: 0.157033 Aug 24 03:52:49.555575 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 44/99] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:49 2022] GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:49.689664 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-70662bad-a847-4ab6-98a7-ba6fca46039a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:49.700804 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-70662bad-a847-4ab6-98a7-ba6fca46039a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1322 microversion: 2.1 time: 0.164910 Aug 24 03:52:49.701437 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 56/100] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:49 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:50.227897 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-5f38e835-ff65-4d81-958d-62c4389d5f03 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:50.228653 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-5f38e835-ff65-4d81-958d-62c4389d5f03 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:50.236973 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5f38e835-ff65-4d81-958d-62c4389d5f03 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:50.237471 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5f38e835-ff65-4d81-958d-62c4389d5f03 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:50.240580 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5f38e835-ff65-4d81-958d-62c4389d5f03 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:50.240580 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5f38e835-ff65-4d81-958d-62c4389d5f03 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:50.240580 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5f38e835-ff65-4d81-958d-62c4389d5f03 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:50.240580 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5f38e835-ff65-4d81-958d-62c4389d5f03 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:50.255019 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c22c48cb-5ba3-4e2e-8d89-22c45be7af68 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:50.256386 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c22c48cb-5ba3-4e2e-8d89-22c45be7af68 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:50.267889 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c22c48cb-5ba3-4e2e-8d89-22c45be7af68 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:50.268761 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c22c48cb-5ba3-4e2e-8d89-22c45be7af68 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:50.269611 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c22c48cb-5ba3-4e2e-8d89-22c45be7af68 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:50.271250 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c22c48cb-5ba3-4e2e-8d89-22c45be7af68 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:50.272200 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c22c48cb-5ba3-4e2e-8d89-22c45be7af68 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:50.272867 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c22c48cb-5ba3-4e2e-8d89-22c45be7af68 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:50.483264 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-c22c48cb-5ba3-4e2e-8d89-22c45be7af68 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:50.498356 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-c22c48cb-5ba3-4e2e-8d89-22c45be7af68 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:50.507894 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-c22c48cb-5ba3-4e2e-8d89-22c45be7af68 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:50.514241 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c22c48cb-5ba3-4e2e-8d89-22c45be7af68 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1407 microversion: 2.20 time: 0.264659 Aug 24 03:52:50.517052 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 57/101] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:50 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1407 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:52:50.555088 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fc59fdc3-b29b-4b7a-9c5a-8aa6e610cd50 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:50.555901 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fc59fdc3-b29b-4b7a-9c5a-8aa6e610cd50 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:50.560489 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-5f38e835-ff65-4d81-958d-62c4389d5f03 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:50.564672 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fc59fdc3-b29b-4b7a-9c5a-8aa6e610cd50 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:50.565304 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fc59fdc3-b29b-4b7a-9c5a-8aa6e610cd50 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:50.565937 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fc59fdc3-b29b-4b7a-9c5a-8aa6e610cd50 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:50.567273 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fc59fdc3-b29b-4b7a-9c5a-8aa6e610cd50 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:50.567897 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fc59fdc3-b29b-4b7a-9c5a-8aa6e610cd50 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:50.573783 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-5f38e835-ff65-4d81-958d-62c4389d5f03 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1361 microversion: 2.1 time: 0.345399 Aug 24 03:52:50.573783 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 45/102] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:50 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1361 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:50.574011 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fc59fdc3-b29b-4b7a-9c5a-8aa6e610cd50 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:50.582826 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-00793418-6b97-4f8a-8438-19f7515a3614 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:50.583522 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-00793418-6b97-4f8a-8438-19f7515a3614 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] [instance: 0090ef1a-b99b-4032-834a-bfa5d112dfc5] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:50.589984 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-00793418-6b97-4f8a-8438-19f7515a3614 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:50.590602 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-00793418-6b97-4f8a-8438-19f7515a3614 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:50.591107 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-00793418-6b97-4f8a-8438-19f7515a3614 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:50.592102 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-00793418-6b97-4f8a-8438-19f7515a3614 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:50.599559 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-00793418-6b97-4f8a-8438-19f7515a3614 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:50.599559 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-00793418-6b97-4f8a-8438-19f7515a3614 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:50.761464 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-00793418-6b97-4f8a-8438-19f7515a3614 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466f40eba2a4975bd13614474ff527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649f222d62844debb70df5ed5e8d44ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:50.761837 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-fc59fdc3-b29b-4b7a-9c5a-8aa6e610cd50 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:50.771212 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fc59fdc3-b29b-4b7a-9c5a-8aa6e610cd50 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b" status: 200 len: 1368 microversion: 2.1 time: 0.233673 Aug 24 03:52:50.773098 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 58/103] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:50 2022] GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b => generated 1368 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:50.780422 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-00793418-6b97-4f8a-8438-19f7515a3614 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] 10.222.0.82 "GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5" status: 200 len: 1315 microversion: 2.1 time: 0.200531 Aug 24 03:52:50.782274 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 46/104] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:50 2022] GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:50.787163 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-85909462-a7ae-4939-b8cb-0b3ac4a100ee tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:50.788283 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-85909462-a7ae-4939-b8cb-0b3ac4a100ee tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:50.796483 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85909462-a7ae-4939-b8cb-0b3ac4a100ee tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:50.797116 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85909462-a7ae-4939-b8cb-0b3ac4a100ee tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:50.797650 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85909462-a7ae-4939-b8cb-0b3ac4a100ee tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:50.799107 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85909462-a7ae-4939-b8cb-0b3ac4a100ee tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:50.800769 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85909462-a7ae-4939-b8cb-0b3ac4a100ee tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:50.806187 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85909462-a7ae-4939-b8cb-0b3ac4a100ee tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:51.032303 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-85909462-a7ae-4939-b8cb-0b3ac4a100ee tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:51.042225 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-85909462-a7ae-4939-b8cb-0b3ac4a100ee tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1322 microversion: 2.1 time: 0.267904 Aug 24 03:52:51.043184 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 59/105] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:50 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1322 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:51.129962 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-1549ad0b-5e53-46ea-a506-a438680c253f req-618d9f8d-6e8c-47df-b787-cfb34371931b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0090ef1a-b99b-4032-834a-bfa5d112dfc5", "name": "network-vif-plugged", "status": "completed", "tag": "47bc5ad1-6e46-4623-a885-45a6a50611df"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:51.140706 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-1549ad0b-5e53-46ea-a506-a438680c253f req-618d9f8d-6e8c-47df-b787-cfb34371931b service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:51.141466 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-1549ad0b-5e53-46ea-a506-a438680c253f req-618d9f8d-6e8c-47df-b787-cfb34371931b service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:51.142034 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-1549ad0b-5e53-46ea-a506-a438680c253f req-618d9f8d-6e8c-47df-b787-cfb34371931b service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:51.156133 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-1549ad0b-5e53-46ea-a506-a438680c253f req-618d9f8d-6e8c-47df-b787-cfb34371931b service nova] Creating event network-vif-plugged:47bc5ad1-6e46-4623-a885-45a6a50611df for instance 0090ef1a-b99b-4032-834a-bfa5d112dfc5 on hv-cinder-85426 Aug 24 03:52:51.162245 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-1549ad0b-5e53-46ea-a506-a438680c253f req-618d9f8d-6e8c-47df-b787-cfb34371931b service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104157 Aug 24 03:52:51.163124 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 47/106] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:52:51.540852 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-480dcb35-5c95-4711-a6ae-4a8f9719523f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:51.541453 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-480dcb35-5c95-4711-a6ae-4a8f9719523f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:51.548022 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-480dcb35-5c95-4711-a6ae-4a8f9719523f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:51.548500 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-480dcb35-5c95-4711-a6ae-4a8f9719523f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:51.548954 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-480dcb35-5c95-4711-a6ae-4a8f9719523f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:51.549953 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-480dcb35-5c95-4711-a6ae-4a8f9719523f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:51.550407 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-480dcb35-5c95-4711-a6ae-4a8f9719523f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:51.550876 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-480dcb35-5c95-4711-a6ae-4a8f9719523f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:51.594580 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-61217d7b-f94e-47d3-8bc2-109015ca0e48 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:51.597261 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-61217d7b-f94e-47d3-8bc2-109015ca0e48 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:51.663585 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-61217d7b-f94e-47d3-8bc2-109015ca0e48 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:51.664064 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-61217d7b-f94e-47d3-8bc2-109015ca0e48 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:51.664493 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-61217d7b-f94e-47d3-8bc2-109015ca0e48 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:51.665229 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-61217d7b-f94e-47d3-8bc2-109015ca0e48 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:51.665800 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-61217d7b-f94e-47d3-8bc2-109015ca0e48 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:51.666127 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-61217d7b-f94e-47d3-8bc2-109015ca0e48 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:51.780077 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-480dcb35-5c95-4711-a6ae-4a8f9719523f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:51.789818 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-480dcb35-5c95-4711-a6ae-4a8f9719523f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:51.791633 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-480dcb35-5c95-4711-a6ae-4a8f9719523f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:51.792767 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-480dcb35-5c95-4711-a6ae-4a8f9719523f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1407 microversion: 2.20 time: 0.256079 Aug 24 03:52:51.793647 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 60/107] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:51 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1407 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:51.806104 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ba27efcb-f8bb-4759-b578-4ae8aa647817 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:51.807072 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ba27efcb-f8bb-4759-b578-4ae8aa647817 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:51.813317 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba27efcb-f8bb-4759-b578-4ae8aa647817 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:51.813800 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba27efcb-f8bb-4759-b578-4ae8aa647817 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:51.814236 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba27efcb-f8bb-4759-b578-4ae8aa647817 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:51.815145 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba27efcb-f8bb-4759-b578-4ae8aa647817 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:51.816353 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba27efcb-f8bb-4759-b578-4ae8aa647817 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:51.817322 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba27efcb-f8bb-4759-b578-4ae8aa647817 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:51.884349 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-61217d7b-f94e-47d3-8bc2-109015ca0e48 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:51.895266 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-61217d7b-f94e-47d3-8bc2-109015ca0e48 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1361 microversion: 2.1 time: 0.305439 Aug 24 03:52:51.895850 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 48/108] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:51 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1361 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:51.917155 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-bf2b8230-1ca4-4e0e-916c-2d559fb71098 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:51.917773 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-bf2b8230-1ca4-4e0e-916c-2d559fb71098 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] [instance: 0090ef1a-b99b-4032-834a-bfa5d112dfc5] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:51.924171 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bf2b8230-1ca4-4e0e-916c-2d559fb71098 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:51.924906 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bf2b8230-1ca4-4e0e-916c-2d559fb71098 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:51.925384 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bf2b8230-1ca4-4e0e-916c-2d559fb71098 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:51.926320 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bf2b8230-1ca4-4e0e-916c-2d559fb71098 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:51.926813 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bf2b8230-1ca4-4e0e-916c-2d559fb71098 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:51.927868 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bf2b8230-1ca4-4e0e-916c-2d559fb71098 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:51.982690 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-ba27efcb-f8bb-4759-b578-4ae8aa647817 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:51.985622 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ba27efcb-f8bb-4759-b578-4ae8aa647817 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b" status: 200 len: 1368 microversion: 2.1 time: 0.183603 Aug 24 03:52:51.989497 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 61/109] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:51 2022] GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b => generated 1368 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:52.080641 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-513a6e4f-8f86-4511-ab26-bda666dbced2 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:52.085799 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-513a6e4f-8f86-4511-ab26-bda666dbced2 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:52.103893 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-513a6e4f-8f86-4511-ab26-bda666dbced2 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:52.104441 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-513a6e4f-8f86-4511-ab26-bda666dbced2 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:52.104876 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-513a6e4f-8f86-4511-ab26-bda666dbced2 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:52.105636 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-513a6e4f-8f86-4511-ab26-bda666dbced2 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:52.106086 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-513a6e4f-8f86-4511-ab26-bda666dbced2 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:52.106808 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-513a6e4f-8f86-4511-ab26-bda666dbced2 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:52.260305 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-513a6e4f-8f86-4511-ab26-bda666dbced2 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:52.274730 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-bf2b8230-1ca4-4e0e-916c-2d559fb71098 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466f40eba2a4975bd13614474ff527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649f222d62844debb70df5ed5e8d44ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:52.283564 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-bf2b8230-1ca4-4e0e-916c-2d559fb71098 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] 10.222.0.82 "GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5" status: 200 len: 1315 microversion: 2.1 time: 0.370612 Aug 24 03:52:52.285062 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 49/110] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:51 2022] GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5 => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:52.287697 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-513a6e4f-8f86-4511-ab26-bda666dbced2 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1322 microversion: 2.1 time: 0.222866 Aug 24 03:52:52.298793 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 62/111] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:52 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:52.816572 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-58117fc8-567f-4ea1-9046-0d1fd26f959d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:52.817792 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-58117fc8-567f-4ea1-9046-0d1fd26f959d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:52.831110 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-58117fc8-567f-4ea1-9046-0d1fd26f959d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:52.831933 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-58117fc8-567f-4ea1-9046-0d1fd26f959d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:52.832476 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-58117fc8-567f-4ea1-9046-0d1fd26f959d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:52.833333 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-58117fc8-567f-4ea1-9046-0d1fd26f959d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:52.833859 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-58117fc8-567f-4ea1-9046-0d1fd26f959d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:52.834345 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-58117fc8-567f-4ea1-9046-0d1fd26f959d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:52.921322 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fd945c28-24ac-4ab0-ae55-e4d248639e31 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:52.921941 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fd945c28-24ac-4ab0-ae55-e4d248639e31 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:52.935023 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd945c28-24ac-4ab0-ae55-e4d248639e31 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:52.935512 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd945c28-24ac-4ab0-ae55-e4d248639e31 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:52.935945 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd945c28-24ac-4ab0-ae55-e4d248639e31 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:52.936856 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd945c28-24ac-4ab0-ae55-e4d248639e31 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:52.937495 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd945c28-24ac-4ab0-ae55-e4d248639e31 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:52.938122 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fd945c28-24ac-4ab0-ae55-e4d248639e31 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:52.990589 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-58117fc8-567f-4ea1-9046-0d1fd26f959d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:53.000042 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-58117fc8-567f-4ea1-9046-0d1fd26f959d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:53.001997 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-58117fc8-567f-4ea1-9046-0d1fd26f959d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:53.014640 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-58117fc8-567f-4ea1-9046-0d1fd26f959d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1407 microversion: 2.20 time: 0.191798 Aug 24 03:52:53.019470 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 50/112] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:52 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:53.036941 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-d63437d9-423e-42c8-886b-fadcc1d6dd53 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:53.037561 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-d63437d9-423e-42c8-886b-fadcc1d6dd53 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:53.052131 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d63437d9-423e-42c8-886b-fadcc1d6dd53 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:53.052625 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d63437d9-423e-42c8-886b-fadcc1d6dd53 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:53.053051 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d63437d9-423e-42c8-886b-fadcc1d6dd53 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:53.054104 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d63437d9-423e-42c8-886b-fadcc1d6dd53 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:53.055549 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d63437d9-423e-42c8-886b-fadcc1d6dd53 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:53.057171 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d63437d9-423e-42c8-886b-fadcc1d6dd53 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:53.085456 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell1:SELECT=100 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:53.115032 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-fd945c28-24ac-4ab0-ae55-e4d248639e31 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:53.122842 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fd945c28-24ac-4ab0-ae55-e4d248639e31 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1361 microversion: 2.1 time: 0.207811 Aug 24 03:52:53.123652 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 63/113] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:52 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1361 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:53.217068 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-d63437d9-423e-42c8-886b-fadcc1d6dd53 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:53.224205 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-d63437d9-423e-42c8-886b-fadcc1d6dd53 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b" status: 200 len: 1368 microversion: 2.1 time: 0.192589 Aug 24 03:52:53.224776 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 51/114] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:53 2022] GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b => generated 1368 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:53.308963 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-d6fb20f0-e8c2-49a9-8318-461343ba33b1 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:53.309155 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8b2271f9-b612-4631-a995-5db0ad329d9c tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:53.309567 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-d6fb20f0-e8c2-49a9-8318-461343ba33b1 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:53.311675 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8b2271f9-b612-4631-a995-5db0ad329d9c tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] [instance: 0090ef1a-b99b-4032-834a-bfa5d112dfc5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:53.316245 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d6fb20f0-e8c2-49a9-8318-461343ba33b1 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:53.316999 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d6fb20f0-e8c2-49a9-8318-461343ba33b1 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:53.317650 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d6fb20f0-e8c2-49a9-8318-461343ba33b1 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:53.318579 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d6fb20f0-e8c2-49a9-8318-461343ba33b1 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:53.319219 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d6fb20f0-e8c2-49a9-8318-461343ba33b1 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:53.319818 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d6fb20f0-e8c2-49a9-8318-461343ba33b1 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:53.321305 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8b2271f9-b612-4631-a995-5db0ad329d9c tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:53.322141 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8b2271f9-b612-4631-a995-5db0ad329d9c tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:53.322792 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8b2271f9-b612-4631-a995-5db0ad329d9c tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:53.324038 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8b2271f9-b612-4631-a995-5db0ad329d9c tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:53.324693 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8b2271f9-b612-4631-a995-5db0ad329d9c tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:53.330896 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8b2271f9-b612-4631-a995-5db0ad329d9c tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:53.470720 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-d6fb20f0-e8c2-49a9-8318-461343ba33b1 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:53.479023 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-d6fb20f0-e8c2-49a9-8318-461343ba33b1 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1322 microversion: 2.1 time: 0.173766 Aug 24 03:52:53.479735 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 52/115] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:53 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:53.491422 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-8b2271f9-b612-4631-a995-5db0ad329d9c tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466f40eba2a4975bd13614474ff527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649f222d62844debb70df5ed5e8d44ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:53.499378 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8b2271f9-b612-4631-a995-5db0ad329d9c tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] 10.222.0.82 "GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5" status: 200 len: 1315 microversion: 2.1 time: 0.197461 Aug 24 03:52:53.499949 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 64/116] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:53 2022] GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:54.026365 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-2e798806-744c-4f82-9b50-9ce4420d3a58 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:54.027006 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-2e798806-744c-4f82-9b50-9ce4420d3a58 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:54.033159 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2e798806-744c-4f82-9b50-9ce4420d3a58 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:54.034197 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2e798806-744c-4f82-9b50-9ce4420d3a58 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:54.034620 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2e798806-744c-4f82-9b50-9ce4420d3a58 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:54.035613 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2e798806-744c-4f82-9b50-9ce4420d3a58 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:54.036100 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2e798806-744c-4f82-9b50-9ce4420d3a58 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:54.036518 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2e798806-744c-4f82-9b50-9ce4420d3a58 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:54.146350 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fddfdaf4-c481-4de9-b139-8884f4fc90af tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:54.146995 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fddfdaf4-c481-4de9-b139-8884f4fc90af tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:54.153249 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fddfdaf4-c481-4de9-b139-8884f4fc90af tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:54.153665 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fddfdaf4-c481-4de9-b139-8884f4fc90af tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:54.154563 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fddfdaf4-c481-4de9-b139-8884f4fc90af tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:54.156446 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fddfdaf4-c481-4de9-b139-8884f4fc90af tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:54.157051 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fddfdaf4-c481-4de9-b139-8884f4fc90af tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:54.157787 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fddfdaf4-c481-4de9-b139-8884f4fc90af tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:54.195310 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-2e798806-744c-4f82-9b50-9ce4420d3a58 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:54.204217 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-2e798806-744c-4f82-9b50-9ce4420d3a58 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:54.206546 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-2e798806-744c-4f82-9b50-9ce4420d3a58 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:54.207870 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-2e798806-744c-4f82-9b50-9ce4420d3a58 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1407 microversion: 2.20 time: 0.185303 Aug 24 03:52:54.222533 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 53/117] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:54 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:54.245945 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-a94a6224-c9e2-4724-b5ec-f79b5ce406df tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:54.246711 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-a94a6224-c9e2-4724-b5ec-f79b5ce406df tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:54.254253 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a94a6224-c9e2-4724-b5ec-f79b5ce406df tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:54.254843 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a94a6224-c9e2-4724-b5ec-f79b5ce406df tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:54.255347 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a94a6224-c9e2-4724-b5ec-f79b5ce406df tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:54.256121 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a94a6224-c9e2-4724-b5ec-f79b5ce406df tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:54.256643 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a94a6224-c9e2-4724-b5ec-f79b5ce406df tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:54.257137 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a94a6224-c9e2-4724-b5ec-f79b5ce406df tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:54.319998 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-fddfdaf4-c481-4de9-b139-8884f4fc90af tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:54.328803 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fddfdaf4-c481-4de9-b139-8884f4fc90af tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1361 microversion: 2.1 time: 0.187673 Aug 24 03:52:54.330197 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 65/118] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:54 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1361 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:54.403714 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-a94a6224-c9e2-4724-b5ec-f79b5ce406df tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:54.413061 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-a94a6224-c9e2-4724-b5ec-f79b5ce406df tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b" status: 200 len: 1368 microversion: 2.1 time: 0.171542 Aug 24 03:52:54.416377 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 54/119] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:54 2022] GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:54.500701 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cdfd6702-5028-4205-8041-6051aba5f26d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:54.501340 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cdfd6702-5028-4205-8041-6051aba5f26d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:54.509583 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cdfd6702-5028-4205-8041-6051aba5f26d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:54.510061 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cdfd6702-5028-4205-8041-6051aba5f26d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:54.510487 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cdfd6702-5028-4205-8041-6051aba5f26d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:54.511195 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cdfd6702-5028-4205-8041-6051aba5f26d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:54.511635 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cdfd6702-5028-4205-8041-6051aba5f26d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:54.512050 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cdfd6702-5028-4205-8041-6051aba5f26d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:54.524049 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-4e9e6e14-6a7f-47ee-8d0c-63f97428f6fe tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:54.526174 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-4e9e6e14-6a7f-47ee-8d0c-63f97428f6fe tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] [instance: 0090ef1a-b99b-4032-834a-bfa5d112dfc5] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:54.532122 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4e9e6e14-6a7f-47ee-8d0c-63f97428f6fe tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:54.532601 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4e9e6e14-6a7f-47ee-8d0c-63f97428f6fe tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:54.533032 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4e9e6e14-6a7f-47ee-8d0c-63f97428f6fe tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:54.533985 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4e9e6e14-6a7f-47ee-8d0c-63f97428f6fe tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:54.534497 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4e9e6e14-6a7f-47ee-8d0c-63f97428f6fe tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:54.534946 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4e9e6e14-6a7f-47ee-8d0c-63f97428f6fe tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:54.770035 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-cdfd6702-5028-4205-8041-6051aba5f26d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:54.770671 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-4e9e6e14-6a7f-47ee-8d0c-63f97428f6fe tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466f40eba2a4975bd13614474ff527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649f222d62844debb70df5ed5e8d44ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:54.783341 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cdfd6702-5028-4205-8041-6051aba5f26d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1322 microversion: 2.1 time: 0.286258 Aug 24 03:52:54.785116 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 66/120] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:54 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:54.794773 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-4e9e6e14-6a7f-47ee-8d0c-63f97428f6fe tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] 10.222.0.82 "GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5" status: 200 len: 1315 microversion: 2.1 time: 0.265090 Aug 24 03:52:54.801817 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 55/121] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:54 2022] GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5 => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:55.024604 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-6802727b-17f3-45d0-8100-597cf3f8b5f9 req-3ec0a353-dcc5-42bf-99ce-b78f69275671 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8b22210-7e08-4f01-bf00-d84b0e5e34d7", "name": "network-vif-plugged", "status": "completed", "tag": "a6ef21fe-e9ce-414a-a115-1f2f2babf6fc"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:55.034810 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-6802727b-17f3-45d0-8100-597cf3f8b5f9 req-3ec0a353-dcc5-42bf-99ce-b78f69275671 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:55.035289 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-6802727b-17f3-45d0-8100-597cf3f8b5f9 req-3ec0a353-dcc5-42bf-99ce-b78f69275671 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:55.035726 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-6802727b-17f3-45d0-8100-597cf3f8b5f9 req-3ec0a353-dcc5-42bf-99ce-b78f69275671 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:55.046916 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-6802727b-17f3-45d0-8100-597cf3f8b5f9 req-3ec0a353-dcc5-42bf-99ce-b78f69275671 service nova] Creating event network-vif-plugged:a6ef21fe-e9ce-414a-a115-1f2f2babf6fc for instance b8b22210-7e08-4f01-bf00-d84b0e5e34d7 on hv-cinder-85426 Aug 24 03:52:55.052226 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-6802727b-17f3-45d0-8100-597cf3f8b5f9 req-3ec0a353-dcc5-42bf-99ce-b78f69275671 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031051 Aug 24 03:52:55.056691 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 67/122] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:52:55.232509 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-e3639047-06e5-4993-9475-a6a08fd27689 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:55.233106 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-e3639047-06e5-4993-9475-a6a08fd27689 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:55.239093 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e3639047-06e5-4993-9475-a6a08fd27689 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:55.239563 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e3639047-06e5-4993-9475-a6a08fd27689 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:55.239990 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e3639047-06e5-4993-9475-a6a08fd27689 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:55.240682 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e3639047-06e5-4993-9475-a6a08fd27689 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:55.241121 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e3639047-06e5-4993-9475-a6a08fd27689 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:55.241527 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e3639047-06e5-4993-9475-a6a08fd27689 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:55.355616 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cbda742e-bd0c-47d4-a91d-f61f29c28aad tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:55.356386 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cbda742e-bd0c-47d4-a91d-f61f29c28aad tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:55.366179 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cbda742e-bd0c-47d4-a91d-f61f29c28aad tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:55.367163 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cbda742e-bd0c-47d4-a91d-f61f29c28aad tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:55.367935 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cbda742e-bd0c-47d4-a91d-f61f29c28aad tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:55.368933 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cbda742e-bd0c-47d4-a91d-f61f29c28aad tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:55.369937 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cbda742e-bd0c-47d4-a91d-f61f29c28aad tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:55.370735 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cbda742e-bd0c-47d4-a91d-f61f29c28aad tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:55.429451 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-e3639047-06e5-4993-9475-a6a08fd27689 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:55.438174 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-e3639047-06e5-4993-9475-a6a08fd27689 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:55.441693 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-e3639047-06e5-4993-9475-a6a08fd27689 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:55.443059 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-e3639047-06e5-4993-9475-a6a08fd27689 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1407 microversion: 2.20 time: 0.214407 Aug 24 03:52:55.443910 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 56/123] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:55 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:55.448997 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-48e1d72a-59c0-406e-a5d6-c0865af530a2 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:55.449579 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-48e1d72a-59c0-406e-a5d6-c0865af530a2 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:55.456180 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-48e1d72a-59c0-406e-a5d6-c0865af530a2 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:55.456836 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-48e1d72a-59c0-406e-a5d6-c0865af530a2 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:55.459973 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-48e1d72a-59c0-406e-a5d6-c0865af530a2 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:55.459973 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-48e1d72a-59c0-406e-a5d6-c0865af530a2 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:55.459973 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-48e1d72a-59c0-406e-a5d6-c0865af530a2 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:55.459973 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-48e1d72a-59c0-406e-a5d6-c0865af530a2 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:55.611562 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-cbda742e-bd0c-47d4-a91d-f61f29c28aad tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:55.622294 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cbda742e-bd0c-47d4-a91d-f61f29c28aad tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1361 microversion: 2.1 time: 0.271971 Aug 24 03:52:55.623347 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 68/124] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:55 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1361 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:55.653309 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-48e1d72a-59c0-406e-a5d6-c0865af530a2 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:55.661309 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-48e1d72a-59c0-406e-a5d6-c0865af530a2 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b" status: 200 len: 1368 microversion: 2.1 time: 0.215972 Aug 24 03:52:55.666033 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 57/125] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:55 2022] GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b => generated 1368 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:55.805879 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-173af298-a459-4ffa-a733-b02d72122461 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:55.806487 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-173af298-a459-4ffa-a733-b02d72122461 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:55.811499 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-5ff24862-321e-47bc-b78e-3d6fcb48eb21 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:55.812436 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-5ff24862-321e-47bc-b78e-3d6fcb48eb21 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] [instance: 0090ef1a-b99b-4032-834a-bfa5d112dfc5] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:55.812582 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-173af298-a459-4ffa-a733-b02d72122461 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:55.813278 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-173af298-a459-4ffa-a733-b02d72122461 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:55.813906 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-173af298-a459-4ffa-a733-b02d72122461 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:55.815518 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-173af298-a459-4ffa-a733-b02d72122461 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:55.816188 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-173af298-a459-4ffa-a733-b02d72122461 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:55.816906 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-173af298-a459-4ffa-a733-b02d72122461 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:55.820969 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5ff24862-321e-47bc-b78e-3d6fcb48eb21 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:55.821647 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5ff24862-321e-47bc-b78e-3d6fcb48eb21 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:55.822109 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5ff24862-321e-47bc-b78e-3d6fcb48eb21 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:55.822880 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5ff24862-321e-47bc-b78e-3d6fcb48eb21 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:55.823546 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5ff24862-321e-47bc-b78e-3d6fcb48eb21 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:55.824146 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5ff24862-321e-47bc-b78e-3d6fcb48eb21 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:55.968365 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-173af298-a459-4ffa-a733-b02d72122461 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:55.969280 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-5ff24862-321e-47bc-b78e-3d6fcb48eb21 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466f40eba2a4975bd13614474ff527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649f222d62844debb70df5ed5e8d44ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:55.977593 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-173af298-a459-4ffa-a733-b02d72122461 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1322 microversion: 2.1 time: 0.175484 Aug 24 03:52:55.978162 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 69/126] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:55 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:55.979185 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-5ff24862-321e-47bc-b78e-3d6fcb48eb21 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] 10.222.0.82 "GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5" status: 200 len: 1501 microversion: 2.1 time: 0.175434 Aug 24 03:52:55.979756 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 58/127] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:55 2022] GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5 => generated 1501 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:56.467204 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9e05f688-ed23-47d8-840c-cdc970ba9f6d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:56.467818 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9e05f688-ed23-47d8-840c-cdc970ba9f6d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:56.474249 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e05f688-ed23-47d8-840c-cdc970ba9f6d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:56.474767 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e05f688-ed23-47d8-840c-cdc970ba9f6d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:56.475406 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e05f688-ed23-47d8-840c-cdc970ba9f6d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:56.476163 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e05f688-ed23-47d8-840c-cdc970ba9f6d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:56.476632 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e05f688-ed23-47d8-840c-cdc970ba9f6d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:56.477063 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e05f688-ed23-47d8-840c-cdc970ba9f6d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:56.644042 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-83f1a55e-3e61-4a5a-9e81-ce3c0cfcc557 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:56.645256 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-83f1a55e-3e61-4a5a-9e81-ce3c0cfcc557 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:56.651607 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-83f1a55e-3e61-4a5a-9e81-ce3c0cfcc557 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:56.652211 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-83f1a55e-3e61-4a5a-9e81-ce3c0cfcc557 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:56.652713 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-83f1a55e-3e61-4a5a-9e81-ce3c0cfcc557 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:56.653522 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-83f1a55e-3e61-4a5a-9e81-ce3c0cfcc557 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:56.654163 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-83f1a55e-3e61-4a5a-9e81-ce3c0cfcc557 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:56.655513 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-83f1a55e-3e61-4a5a-9e81-ce3c0cfcc557 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:56.680512 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-9e05f688-ed23-47d8-840c-cdc970ba9f6d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:56.719251 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-9e05f688-ed23-47d8-840c-cdc970ba9f6d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:56.721774 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-9e05f688-ed23-47d8-840c-cdc970ba9f6d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:56.723017 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9e05f688-ed23-47d8-840c-cdc970ba9f6d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1407 microversion: 2.20 time: 0.259698 Aug 24 03:52:56.723585 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 70/128] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:56 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1407 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:52:56.742396 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-470986db-ee89-4c58-8e4b-9369ab556dfe tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:56.743111 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-470986db-ee89-4c58-8e4b-9369ab556dfe tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:56.757692 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-470986db-ee89-4c58-8e4b-9369ab556dfe tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:56.758763 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-470986db-ee89-4c58-8e4b-9369ab556dfe tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:56.758763 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-470986db-ee89-4c58-8e4b-9369ab556dfe tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:56.762542 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-470986db-ee89-4c58-8e4b-9369ab556dfe tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:56.763053 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-470986db-ee89-4c58-8e4b-9369ab556dfe tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:56.763487 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-470986db-ee89-4c58-8e4b-9369ab556dfe tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:56.837134 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-83f1a55e-3e61-4a5a-9e81-ce3c0cfcc557 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:56.845626 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-83f1a55e-3e61-4a5a-9e81-ce3c0cfcc557 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1361 microversion: 2.1 time: 0.206281 Aug 24 03:52:56.846203 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 59/129] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:56 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1361 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:56.998673 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-aeb76dc7-0f8a-45d9-a8af-7046c4737a85 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:57.000249 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-aeb76dc7-0f8a-45d9-a8af-7046c4737a85 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:57.021604 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-aeb76dc7-0f8a-45d9-a8af-7046c4737a85 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:57.022381 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-aeb76dc7-0f8a-45d9-a8af-7046c4737a85 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:57.023976 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-aeb76dc7-0f8a-45d9-a8af-7046c4737a85 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:57.024928 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-aeb76dc7-0f8a-45d9-a8af-7046c4737a85 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:57.025859 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-aeb76dc7-0f8a-45d9-a8af-7046c4737a85 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:57.027265 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-aeb76dc7-0f8a-45d9-a8af-7046c4737a85 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:57.050088 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-470986db-ee89-4c58-8e4b-9369ab556dfe tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:57.065280 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-470986db-ee89-4c58-8e4b-9369ab556dfe tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b" status: 200 len: 1368 microversion: 2.1 time: 0.339289 Aug 24 03:52:57.066099 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 71/130] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:56 2022] GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b => generated 1368 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:57.073746 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-a880f7fb-6850-48c9-b7d2-5c044dc286eb req-55f5e272-8746-4aa2-afcd-b30b5600ebda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b3eb1f1-0fc7-492c-9fba-02f817e5614c", "name": "network-vif-plugged", "status": "completed", "tag": "ba8506c6-f70f-4108-ae97-aa90b43d1fae"}, {"server_uuid": "13f1df4b-056e-4637-a0ec-54f6f78c8730", "name": "network-vif-plugged", "status": "completed", "tag": "033aff9c-871d-43e1-8321-7f6d1b63cadb"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:57.085956 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-a880f7fb-6850-48c9-b7d2-5c044dc286eb req-55f5e272-8746-4aa2-afcd-b30b5600ebda service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:57.086753 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-a880f7fb-6850-48c9-b7d2-5c044dc286eb req-55f5e272-8746-4aa2-afcd-b30b5600ebda service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:57.087627 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-a880f7fb-6850-48c9-b7d2-5c044dc286eb req-55f5e272-8746-4aa2-afcd-b30b5600ebda service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:57.092392 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:57.103442 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-a880f7fb-6850-48c9-b7d2-5c044dc286eb req-55f5e272-8746-4aa2-afcd-b30b5600ebda service nova] Creating event network-vif-plugged:ba8506c6-f70f-4108-ae97-aa90b43d1fae for instance 9b3eb1f1-0fc7-492c-9fba-02f817e5614c on hv-cinder-85426 Aug 24 03:52:57.103948 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-a880f7fb-6850-48c9-b7d2-5c044dc286eb req-55f5e272-8746-4aa2-afcd-b30b5600ebda service nova] Creating event network-vif-plugged:033aff9c-871d-43e1-8321-7f6d1b63cadb for instance 13f1df4b-056e-4637-a0ec-54f6f78c8730 on hv-cinder-85426 Aug 24 03:52:57.110487 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-a880f7fb-6850-48c9-b7d2-5c044dc286eb req-55f5e272-8746-4aa2-afcd-b30b5600ebda service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041368 Aug 24 03:52:57.111148 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 72/131] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:52:57.251132 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-aeb76dc7-0f8a-45d9-a8af-7046c4737a85 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:57.260420 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-aeb76dc7-0f8a-45d9-a8af-7046c4737a85 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1322 microversion: 2.1 time: 0.266554 Aug 24 03:52:57.261350 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 60/132] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:56 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:57.746203 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d66b59c1-62e2-47ad-a2d2-12440e2bc178 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:57.747032 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d66b59c1-62e2-47ad-a2d2-12440e2bc178 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:57.757397 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d66b59c1-62e2-47ad-a2d2-12440e2bc178 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:57.758011 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d66b59c1-62e2-47ad-a2d2-12440e2bc178 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:57.758750 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d66b59c1-62e2-47ad-a2d2-12440e2bc178 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:57.759662 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d66b59c1-62e2-47ad-a2d2-12440e2bc178 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:57.760349 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d66b59c1-62e2-47ad-a2d2-12440e2bc178 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:57.760988 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d66b59c1-62e2-47ad-a2d2-12440e2bc178 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:57.868097 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-29f34c69-6696-42d1-a014-37c8cd3951ad tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:57.868762 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-29f34c69-6696-42d1-a014-37c8cd3951ad tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:57.876248 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-29f34c69-6696-42d1-a014-37c8cd3951ad tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:57.878060 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-29f34c69-6696-42d1-a014-37c8cd3951ad tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:57.878537 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-29f34c69-6696-42d1-a014-37c8cd3951ad tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:57.879258 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-29f34c69-6696-42d1-a014-37c8cd3951ad tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:57.879714 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-29f34c69-6696-42d1-a014-37c8cd3951ad tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:57.880135 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-29f34c69-6696-42d1-a014-37c8cd3951ad tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:57.985257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-d66b59c1-62e2-47ad-a2d2-12440e2bc178 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:58.000421 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-d66b59c1-62e2-47ad-a2d2-12440e2bc178 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:58.012420 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-d66b59c1-62e2-47ad-a2d2-12440e2bc178 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:58.014227 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d66b59c1-62e2-47ad-a2d2-12440e2bc178 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1599 microversion: 2.20 time: 0.272338 Aug 24 03:52:58.015259 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 73/133] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:57 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1599 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:58.028887 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d2813337-d461-4c39-8a9e-b1d9d50009a5 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "823b1799-408d-43e7-86a2-8587201e042b"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:58.032004 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d2813337-d461-4c39-8a9e-b1d9d50009a5 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] [instance: 0090ef1a-b99b-4032-834a-bfa5d112dfc5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:58.039545 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2813337-d461-4c39-8a9e-b1d9d50009a5 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:58.040032 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2813337-d461-4c39-8a9e-b1d9d50009a5 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:58.040636 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2813337-d461-4c39-8a9e-b1d9d50009a5 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:58.041492 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2813337-d461-4c39-8a9e-b1d9d50009a5 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:58.042097 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2813337-d461-4c39-8a9e-b1d9d50009a5 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:58.042715 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d2813337-d461-4c39-8a9e-b1d9d50009a5 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:58.098365 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-29f34c69-6696-42d1-a014-37c8cd3951ad tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:58.107739 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-29f34c69-6696-42d1-a014-37c8cd3951ad tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1361 microversion: 2.1 time: 0.243361 Aug 24 03:52:58.108860 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 61/134] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:57 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1361 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:58.114529 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-6774a382-e538-49b9-98e0-21a100e6539f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:58.115499 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-6774a382-e538-49b9-98e0-21a100e6539f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:58.121668 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6774a382-e538-49b9-98e0-21a100e6539f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:58.122395 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6774a382-e538-49b9-98e0-21a100e6539f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:58.123004 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6774a382-e538-49b9-98e0-21a100e6539f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:58.123855 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6774a382-e538-49b9-98e0-21a100e6539f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:58.124451 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6774a382-e538-49b9-98e0-21a100e6539f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:58.125019 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6774a382-e538-49b9-98e0-21a100e6539f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:58.273319 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-6774a382-e538-49b9-98e0-21a100e6539f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.163080 Aug 24 03:52:58.274476 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 62/135] 10.222.0.82 () {60 vars in 1316 bytes} [Wed Aug 24 03:52:58 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7/os-interface => generated 284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:52:58.280908 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-7a5a3320-8fca-457a-9f9e-741ebf01f217 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:58.295084 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-7a5a3320-8fca-457a-9f9e-741ebf01f217 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:58.306063 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7a5a3320-8fca-457a-9f9e-741ebf01f217 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:58.306063 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7a5a3320-8fca-457a-9f9e-741ebf01f217 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:58.306063 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7a5a3320-8fca-457a-9f9e-741ebf01f217 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:58.306063 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7a5a3320-8fca-457a-9f9e-741ebf01f217 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:58.306637 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7a5a3320-8fca-457a-9f9e-741ebf01f217 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:58.306637 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7a5a3320-8fca-457a-9f9e-741ebf01f217 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:58.453607 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-7a5a3320-8fca-457a-9f9e-741ebf01f217 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:58.467753 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-7a5a3320-8fca-457a-9f9e-741ebf01f217 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b" status: 200 len: 1368 microversion: 2.1 time: 0.191970 Aug 24 03:52:58.468569 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 63/136] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:58 2022] GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b => generated 1368 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:58.474532 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-d1b8825b-22d3-46ff-95c1-0559a2dd582d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:58.475474 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-d1b8825b-22d3-46ff-95c1-0559a2dd582d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:58.488228 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d1b8825b-22d3-46ff-95c1-0559a2dd582d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:58.489057 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d1b8825b-22d3-46ff-95c1-0559a2dd582d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:58.489644 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d1b8825b-22d3-46ff-95c1-0559a2dd582d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:58.490723 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d1b8825b-22d3-46ff-95c1-0559a2dd582d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:58.498563 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d1b8825b-22d3-46ff-95c1-0559a2dd582d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:58.498563 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d1b8825b-22d3-46ff-95c1-0559a2dd582d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:58.709038 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-d1b8825b-22d3-46ff-95c1-0559a2dd582d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:58.721301 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-d1b8825b-22d3-46ff-95c1-0559a2dd582d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1322 microversion: 2.1 time: 0.250904 Aug 24 03:52:58.726621 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 64/137] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:58 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:59.166046 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-ba813983-9de7-4a6b-be05-09760f6843d6 req-b389bd27-d505-468f-9ee5-03fe5fe757a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aa2d996-08d6-46ce-b978-5de69b34a0f6", "name": "network-vif-plugged", "status": "completed", "tag": "857c15de-4f2d-494e-a54d-e21ae0588263"}, {"server_uuid": "dd0bdd49-e4b5-4819-91f5-399d77f4dd4b", "name": "network-vif-plugged", "status": "completed", "tag": "b3a05365-20ef-4b17-b002-533b96739ce0"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:59.166046 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-ba813983-9de7-4a6b-be05-09760f6843d6 req-b389bd27-d505-468f-9ee5-03fe5fe757a2 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:59.166046 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-ba813983-9de7-4a6b-be05-09760f6843d6 req-b389bd27-d505-468f-9ee5-03fe5fe757a2 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:59.167584 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-ba813983-9de7-4a6b-be05-09760f6843d6 req-b389bd27-d505-468f-9ee5-03fe5fe757a2 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:59.167584 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-ba813983-9de7-4a6b-be05-09760f6843d6 req-b389bd27-d505-468f-9ee5-03fe5fe757a2 service nova] Creating event network-vif-plugged:857c15de-4f2d-494e-a54d-e21ae0588263 for instance 0aa2d996-08d6-46ce-b978-5de69b34a0f6 on hv-cinder-85426 Aug 24 03:52:59.167584 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-ba813983-9de7-4a6b-be05-09760f6843d6 req-b389bd27-d505-468f-9ee5-03fe5fe757a2 service nova] Creating event network-vif-plugged:b3a05365-20ef-4b17-b002-533b96739ce0 for instance dd0bdd49-e4b5-4819-91f5-399d77f4dd4b on hv-cinder-85426 Aug 24 03:52:59.167584 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-ba813983-9de7-4a6b-be05-09760f6843d6 req-b389bd27-d505-468f-9ee5-03fe5fe757a2 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040020 Aug 24 03:52:59.167584 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 65/138] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:52:59.168397 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-85b1ace4-e6b5-4941-abff-f6aab5d27991 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:59.169057 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-85b1ace4-e6b5-4941-abff-f6aab5d27991 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:59.177107 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-85b1ace4-e6b5-4941-abff-f6aab5d27991 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:59.189304 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-85b1ace4-e6b5-4941-abff-f6aab5d27991 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:59.189304 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-85b1ace4-e6b5-4941-abff-f6aab5d27991 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:59.189304 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-85b1ace4-e6b5-4941-abff-f6aab5d27991 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:59.189304 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-85b1ace4-e6b5-4941-abff-f6aab5d27991 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:59.190130 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-85b1ace4-e6b5-4941-abff-f6aab5d27991 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:59.401167 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-85b1ace4-e6b5-4941-abff-f6aab5d27991 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:59.410978 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-85b1ace4-e6b5-4941-abff-f6aab5d27991 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1361 microversion: 2.1 time: 0.246197 Aug 24 03:52:59.412640 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 66/139] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:59 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1361 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:59.489337 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-6e2651b0-7e2f-4627-b14f-59e396980e65 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:59.493993 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-6e2651b0-7e2f-4627-b14f-59e396980e65 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:59.494771 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_api:SELECT=100 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:59.499267 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6e2651b0-7e2f-4627-b14f-59e396980e65 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:59.499729 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6e2651b0-7e2f-4627-b14f-59e396980e65 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:59.500156 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6e2651b0-7e2f-4627-b14f-59e396980e65 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:59.500841 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6e2651b0-7e2f-4627-b14f-59e396980e65 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:59.501300 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6e2651b0-7e2f-4627-b14f-59e396980e65 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:59.501730 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6e2651b0-7e2f-4627-b14f-59e396980e65 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:59.644655 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-6e2651b0-7e2f-4627-b14f-59e396980e65 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:59.652400 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-6e2651b0-7e2f-4627-b14f-59e396980e65 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b" status: 200 len: 1368 microversion: 2.1 time: 0.166952 Aug 24 03:52:59.652976 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 67/140] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:59 2022] GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:59.743111 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-f6d7cb67-f0fa-4a7c-952f-16213c1a2dc9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:59.743494 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-f6d7cb67-f0fa-4a7c-952f-16213c1a2dc9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:59.749535 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f6d7cb67-f0fa-4a7c-952f-16213c1a2dc9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:59.750019 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f6d7cb67-f0fa-4a7c-952f-16213c1a2dc9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:59.750457 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f6d7cb67-f0fa-4a7c-952f-16213c1a2dc9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:59.751334 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f6d7cb67-f0fa-4a7c-952f-16213c1a2dc9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:59.751807 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f6d7cb67-f0fa-4a7c-952f-16213c1a2dc9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:59.752387 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f6d7cb67-f0fa-4a7c-952f-16213c1a2dc9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:59.895388 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-f6d7cb67-f0fa-4a7c-952f-16213c1a2dc9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:59.908720 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-f6d7cb67-f0fa-4a7c-952f-16213c1a2dc9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1322 microversion: 2.1 time: 0.164423 Aug 24 03:52:59.908720 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 68/141] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:59 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:00.435149 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-b6993d96-9e22-4a68-9c9c-7090b01a12db tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:00.436028 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-b6993d96-9e22-4a68-9c9c-7090b01a12db tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:00.448561 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b6993d96-9e22-4a68-9c9c-7090b01a12db tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:00.449248 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b6993d96-9e22-4a68-9c9c-7090b01a12db tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:00.449853 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b6993d96-9e22-4a68-9c9c-7090b01a12db tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:00.450813 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b6993d96-9e22-4a68-9c9c-7090b01a12db tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:00.451615 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b6993d96-9e22-4a68-9c9c-7090b01a12db tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:00.452249 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b6993d96-9e22-4a68-9c9c-7090b01a12db tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:00.458536 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell1:SELECT=100 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:00.644778 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-b6993d96-9e22-4a68-9c9c-7090b01a12db tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:00.653467 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-b6993d96-9e22-4a68-9c9c-7090b01a12db tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1361 microversion: 2.1 time: 0.222262 Aug 24 03:53:00.654977 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 69/142] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:00 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1361 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:00.663151 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-67a784c9-3d2c-4f9d-9d68-a2935310b9b5 req-4ee9543b-3cc9-48f4-9f4f-a81c3364b8f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8b22210-7e08-4f01-bf00-d84b0e5e34d7", "tag": "a6ef21fe-e9ce-414a-a115-1f2f2babf6fc"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:00.681981 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-67a784c9-3d2c-4f9d-9d68-a2935310b9b5 req-4ee9543b-3cc9-48f4-9f4f-a81c3364b8f0 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:00.681981 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-67a784c9-3d2c-4f9d-9d68-a2935310b9b5 req-4ee9543b-3cc9-48f4-9f4f-a81c3364b8f0 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:00.681981 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-67a784c9-3d2c-4f9d-9d68-a2935310b9b5 req-4ee9543b-3cc9-48f4-9f4f-a81c3364b8f0 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:00.695287 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-67a784c9-3d2c-4f9d-9d68-a2935310b9b5 req-4ee9543b-3cc9-48f4-9f4f-a81c3364b8f0 service nova] Creating event network-changed:a6ef21fe-e9ce-414a-a115-1f2f2babf6fc for instance b8b22210-7e08-4f01-bf00-d84b0e5e34d7 on hv-cinder-85426 Aug 24 03:53:00.701182 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-67a784c9-3d2c-4f9d-9d68-a2935310b9b5 req-4ee9543b-3cc9-48f4-9f4f-a81c3364b8f0 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044762 Aug 24 03:53:00.701872 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 70/143] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:53:00.710450 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-1bdbb5bf-5731-4d8e-906e-63122d2792b3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:00.711175 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-1bdbb5bf-5731-4d8e-906e-63122d2792b3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:00.717632 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1bdbb5bf-5731-4d8e-906e-63122d2792b3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:00.718106 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1bdbb5bf-5731-4d8e-906e-63122d2792b3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:00.718770 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1bdbb5bf-5731-4d8e-906e-63122d2792b3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:00.719396 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1bdbb5bf-5731-4d8e-906e-63122d2792b3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:00.720393 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1bdbb5bf-5731-4d8e-906e-63122d2792b3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:00.720814 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1bdbb5bf-5731-4d8e-906e-63122d2792b3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:00.910050 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-1bdbb5bf-5731-4d8e-906e-63122d2792b3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:00.923852 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-1bdbb5bf-5731-4d8e-906e-63122d2792b3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b" status: 200 len: 1368 microversion: 2.1 time: 0.219978 Aug 24 03:53:00.930743 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 71/144] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:00 2022] GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b => generated 1368 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:00.947319 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-f6b8babf-1f10-45ea-a2f5-4d21a8ad283f tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:00.948187 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-f6b8babf-1f10-45ea-a2f5-4d21a8ad283f tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:00.957061 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f6b8babf-1f10-45ea-a2f5-4d21a8ad283f tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:00.957835 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f6b8babf-1f10-45ea-a2f5-4d21a8ad283f tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:00.958438 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f6b8babf-1f10-45ea-a2f5-4d21a8ad283f tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:00.959428 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f6b8babf-1f10-45ea-a2f5-4d21a8ad283f tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:00.959884 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f6b8babf-1f10-45ea-a2f5-4d21a8ad283f tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:00.960308 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f6b8babf-1f10-45ea-a2f5-4d21a8ad283f tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:01.134641 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-f6b8babf-1f10-45ea-a2f5-4d21a8ad283f tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:01.146151 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-f6b8babf-1f10-45ea-a2f5-4d21a8ad283f tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1516 microversion: 2.1 time: 0.214102 Aug 24 03:53:01.154534 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 72/145] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:00 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1516 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:01.177812 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-421ae13e-01bb-463f-aabc-5153a93c6350 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:01.187109 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-421ae13e-01bb-463f-aabc-5153a93c6350 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:01.206345 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-421ae13e-01bb-463f-aabc-5153a93c6350 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:01.208626 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-421ae13e-01bb-463f-aabc-5153a93c6350 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:01.209256 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-421ae13e-01bb-463f-aabc-5153a93c6350 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:01.212083 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-421ae13e-01bb-463f-aabc-5153a93c6350 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:01.213738 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-421ae13e-01bb-463f-aabc-5153a93c6350 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:01.219750 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-421ae13e-01bb-463f-aabc-5153a93c6350 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:01.292575 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.objects.instance [None req-421ae13e-01bb-463f-aabc-5153a93c6350 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lazy-loading 'flavor' on Instance uuid 9b3eb1f1-0fc7-492c-9fba-02f817e5614c {{(pid=127869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:53:01.909703 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-421ae13e-01bb-463f-aabc-5153a93c6350 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "POST /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c/action" status: 200 len: 32 microversion: 2.1 time: 0.744536 Aug 24 03:53:01.914856 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 73/146] 10.222.0.82 () {60 vars in 1278 bytes} [Wed Aug 24 03:53:01 2022] POST /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c/action => generated 32 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:53:01.917519 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-d8568b17-ed81-4680-8995-1a5906dbc481 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:01.917839 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-d8568b17-ed81-4680-8995-1a5906dbc481 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:01.937832 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d8568b17-ed81-4680-8995-1a5906dbc481 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:01.938621 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d8568b17-ed81-4680-8995-1a5906dbc481 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:01.939395 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d8568b17-ed81-4680-8995-1a5906dbc481 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:01.940459 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d8568b17-ed81-4680-8995-1a5906dbc481 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:01.940980 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d8568b17-ed81-4680-8995-1a5906dbc481 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:01.941410 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d8568b17-ed81-4680-8995-1a5906dbc481 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:02.082845 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d2813337-d461-4c39-8a9e-b1d9d50009a5 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] 10.222.0.82 "POST /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.066074 Aug 24 03:53:02.085323 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 74/147] 10.222.0.82 () {60 vars in 1323 bytes} [Wed Aug 24 03:52:58 2022] POST /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5/os-volume_attachments => generated 194 bytes in 4068 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:53:02.091755 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-98fbc740-36ff-4cbe-aca6-c4b79447cd97 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:02.094721 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-98fbc740-36ff-4cbe-aca6-c4b79447cd97 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:02.112224 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-98fbc740-36ff-4cbe-aca6-c4b79447cd97 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:02.113915 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-98fbc740-36ff-4cbe-aca6-c4b79447cd97 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:02.114724 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-98fbc740-36ff-4cbe-aca6-c4b79447cd97 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:02.115615 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-98fbc740-36ff-4cbe-aca6-c4b79447cd97 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:02.116399 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-98fbc740-36ff-4cbe-aca6-c4b79447cd97 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:02.116978 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-98fbc740-36ff-4cbe-aca6-c4b79447cd97 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:02.200421 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-d8568b17-ed81-4680-8995-1a5906dbc481 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:02.211464 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-d8568b17-ed81-4680-8995-1a5906dbc481 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1361 microversion: 2.1 time: 0.299501 Aug 24 03:53:02.212047 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 74/148] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:01 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1361 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:02.219254 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-68a7a1d4-1014-4241-a754-96caa2ea5f70 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:02.220298 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-68a7a1d4-1014-4241-a754-96caa2ea5f70 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:02.228202 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-68a7a1d4-1014-4241-a754-96caa2ea5f70 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:02.228842 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-68a7a1d4-1014-4241-a754-96caa2ea5f70 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:02.230245 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-68a7a1d4-1014-4241-a754-96caa2ea5f70 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:02.234563 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-68a7a1d4-1014-4241-a754-96caa2ea5f70 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:02.234563 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-68a7a1d4-1014-4241-a754-96caa2ea5f70 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:02.234563 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-68a7a1d4-1014-4241-a754-96caa2ea5f70 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:02.306780 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-98fbc740-36ff-4cbe-aca6-c4b79447cd97 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:02.325626 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-98fbc740-36ff-4cbe-aca6-c4b79447cd97 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.239844 Aug 24 03:53:02.341229 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 75/149] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:02 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:02.506585 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-68a7a1d4-1014-4241-a754-96caa2ea5f70 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:02.520393 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-68a7a1d4-1014-4241-a754-96caa2ea5f70 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b" status: 200 len: 1368 microversion: 2.1 time: 0.306200 Aug 24 03:53:02.521224 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 75/150] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:02 2022] GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b => generated 1368 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:03.235454 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e2d48e57-e907-48a2-8d17-68bdc045dc9b tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:03.236854 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e2d48e57-e907-48a2-8d17-68bdc045dc9b tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:03.252402 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e2d48e57-e907-48a2-8d17-68bdc045dc9b tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:03.253385 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e2d48e57-e907-48a2-8d17-68bdc045dc9b tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:03.259381 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e2d48e57-e907-48a2-8d17-68bdc045dc9b tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:03.260132 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e2d48e57-e907-48a2-8d17-68bdc045dc9b tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:03.261057 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e2d48e57-e907-48a2-8d17-68bdc045dc9b tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:03.261057 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e2d48e57-e907-48a2-8d17-68bdc045dc9b tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:03.357615 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-1d17d05d-954f-4fc5-b51e-e14940bae0c8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:03.358372 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-1d17d05d-954f-4fc5-b51e-e14940bae0c8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:03.365705 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1d17d05d-954f-4fc5-b51e-e14940bae0c8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:03.366696 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1d17d05d-954f-4fc5-b51e-e14940bae0c8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:03.367333 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1d17d05d-954f-4fc5-b51e-e14940bae0c8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:03.368215 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1d17d05d-954f-4fc5-b51e-e14940bae0c8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:03.368962 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1d17d05d-954f-4fc5-b51e-e14940bae0c8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:03.369380 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1d17d05d-954f-4fc5-b51e-e14940bae0c8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:03.451502 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-e2d48e57-e907-48a2-8d17-68bdc045dc9b tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:03.462181 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e2d48e57-e907-48a2-8d17-68bdc045dc9b tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1361 microversion: 2.1 time: 0.231010 Aug 24 03:53:03.462829 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 76/151] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:03 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1361 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:03.530877 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-1d17d05d-954f-4fc5-b51e-e14940bae0c8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:03.540459 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-1d17d05d-954f-4fc5-b51e-e14940bae0c8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.187059 Aug 24 03:53:03.544377 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ea00a6ac-131e-4995-80fd-48c2bd600127 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:03.544377 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ea00a6ac-131e-4995-80fd-48c2bd600127 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:03.555565 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea00a6ac-131e-4995-80fd-48c2bd600127 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:03.555565 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea00a6ac-131e-4995-80fd-48c2bd600127 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:03.555565 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea00a6ac-131e-4995-80fd-48c2bd600127 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:03.555565 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea00a6ac-131e-4995-80fd-48c2bd600127 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:03.555887 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 76/152] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:03 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:03.555989 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea00a6ac-131e-4995-80fd-48c2bd600127 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:03.555989 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea00a6ac-131e-4995-80fd-48c2bd600127 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:03.784462 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-ea00a6ac-131e-4995-80fd-48c2bd600127 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:03.794674 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ea00a6ac-131e-4995-80fd-48c2bd600127 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b" status: 200 len: 1368 microversion: 2.1 time: 0.255610 Aug 24 03:53:03.805991 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 77/153] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:03 2022] GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b => generated 1368 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:04.487492 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-f9c1e1f8-8da5-4c68-87cf-a157d6e48ec7 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:04.488234 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-f9c1e1f8-8da5-4c68-87cf-a157d6e48ec7 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:04.494886 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f9c1e1f8-8da5-4c68-87cf-a157d6e48ec7 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:04.495689 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f9c1e1f8-8da5-4c68-87cf-a157d6e48ec7 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:04.495866 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f9c1e1f8-8da5-4c68-87cf-a157d6e48ec7 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:04.496822 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f9c1e1f8-8da5-4c68-87cf-a157d6e48ec7 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:04.497423 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f9c1e1f8-8da5-4c68-87cf-a157d6e48ec7 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:04.498073 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f9c1e1f8-8da5-4c68-87cf-a157d6e48ec7 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:04.566013 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-76f86184-bb4d-4201-a107-172596367324 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:04.567633 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-76f86184-bb4d-4201-a107-172596367324 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:04.580324 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:04.581967 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76f86184-bb4d-4201-a107-172596367324 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:04.582450 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76f86184-bb4d-4201-a107-172596367324 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:04.582902 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76f86184-bb4d-4201-a107-172596367324 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:04.583600 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76f86184-bb4d-4201-a107-172596367324 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:04.584064 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76f86184-bb4d-4201-a107-172596367324 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:04.584481 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76f86184-bb4d-4201-a107-172596367324 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:04.645531 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-f9c1e1f8-8da5-4c68-87cf-a157d6e48ec7 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:04.653277 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-f9c1e1f8-8da5-4c68-87cf-a157d6e48ec7 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1547 microversion: 2.1 time: 0.172358 Aug 24 03:53:04.654116 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 77/154] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:04 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1547 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:04.677529 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-e21fdcb3-1bea-47f2-97b2-0d6354da0561 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:04.679569 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-e21fdcb3-1bea-47f2-97b2-0d6354da0561 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:04.697668 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e21fdcb3-1bea-47f2-97b2-0d6354da0561 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:04.698166 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e21fdcb3-1bea-47f2-97b2-0d6354da0561 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:04.702934 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e21fdcb3-1bea-47f2-97b2-0d6354da0561 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:04.703752 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e21fdcb3-1bea-47f2-97b2-0d6354da0561 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:04.705326 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e21fdcb3-1bea-47f2-97b2-0d6354da0561 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:04.706150 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e21fdcb3-1bea-47f2-97b2-0d6354da0561 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:04.831738 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-76f86184-bb4d-4201-a107-172596367324 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:04.840181 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-76f86184-bb4d-4201-a107-172596367324 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.279660 Aug 24 03:53:04.841312 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 78/155] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:04 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:04.846875 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8a2d334b-0aa7-4652-8203-1b2b9a7f475c tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:04.847668 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8a2d334b-0aa7-4652-8203-1b2b9a7f475c tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:04.854434 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8a2d334b-0aa7-4652-8203-1b2b9a7f475c tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:04.855270 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8a2d334b-0aa7-4652-8203-1b2b9a7f475c tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:04.856092 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8a2d334b-0aa7-4652-8203-1b2b9a7f475c tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:04.857066 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8a2d334b-0aa7-4652-8203-1b2b9a7f475c tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:04.857737 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8a2d334b-0aa7-4652-8203-1b2b9a7f475c tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:04.858172 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8a2d334b-0aa7-4652-8203-1b2b9a7f475c tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:04.902826 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-e21fdcb3-1bea-47f2-97b2-0d6354da0561 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.230845 Aug 24 03:53:04.903429 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 78/156] 10.222.0.82 () {58 vars in 1275 bytes} [Wed Aug 24 03:53:04 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6/os-interface => generated 284 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:53:05.037054 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-8a2d334b-0aa7-4652-8203-1b2b9a7f475c tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:05.041373 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8a2d334b-0aa7-4652-8203-1b2b9a7f475c tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b" status: 200 len: 1368 microversion: 2.1 time: 0.198936 Aug 24 03:53:05.042033 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 79/157] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:04 2022] GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b => generated 1368 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:05.862669 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-cef8105c-79ec-4e10-923f-7a3ae942305c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:05.863356 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-cef8105c-79ec-4e10-923f-7a3ae942305c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:05.870024 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cef8105c-79ec-4e10-923f-7a3ae942305c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:05.870709 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cef8105c-79ec-4e10-923f-7a3ae942305c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:05.871314 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cef8105c-79ec-4e10-923f-7a3ae942305c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:05.872011 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cef8105c-79ec-4e10-923f-7a3ae942305c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:05.872539 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cef8105c-79ec-4e10-923f-7a3ae942305c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:05.872963 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cef8105c-79ec-4e10-923f-7a3ae942305c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:06.066821 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f5cc87d7-2e40-4402-b8a6-e266a9f0cb33 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:06.071234 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f5cc87d7-2e40-4402-b8a6-e266a9f0cb33 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:06.074918 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f5cc87d7-2e40-4402-b8a6-e266a9f0cb33 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:06.075677 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f5cc87d7-2e40-4402-b8a6-e266a9f0cb33 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:06.076340 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f5cc87d7-2e40-4402-b8a6-e266a9f0cb33 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:06.077311 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f5cc87d7-2e40-4402-b8a6-e266a9f0cb33 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:06.077834 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f5cc87d7-2e40-4402-b8a6-e266a9f0cb33 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:06.078328 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f5cc87d7-2e40-4402-b8a6-e266a9f0cb33 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:06.208186 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-cef8105c-79ec-4e10-923f-7a3ae942305c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:06.220368 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-cef8105c-79ec-4e10-923f-7a3ae942305c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.362295 Aug 24 03:53:06.222380 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 79/158] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:05 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:06.333947 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-f5cc87d7-2e40-4402-b8a6-e266a9f0cb33 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:06.346899 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f5cc87d7-2e40-4402-b8a6-e266a9f0cb33 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b" status: 200 len: 1559 microversion: 2.1 time: 0.285658 Aug 24 03:53:06.347503 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 80/159] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:06 2022] GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b => generated 1559 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:06.377404 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-23768084-00ba-4c51-acd4-597646c65c72 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:06.379434 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-23768084-00ba-4c51-acd4-597646c65c72 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:06.385838 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-23768084-00ba-4c51-acd4-597646c65c72 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:06.386654 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-23768084-00ba-4c51-acd4-597646c65c72 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:06.387470 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-23768084-00ba-4c51-acd4-597646c65c72 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:06.388570 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-23768084-00ba-4c51-acd4-597646c65c72 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:06.389016 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-23768084-00ba-4c51-acd4-597646c65c72 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:06.389631 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-23768084-00ba-4c51-acd4-597646c65c72 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:06.622798 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-23768084-00ba-4c51-acd4-597646c65c72 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.246570 Aug 24 03:53:06.622798 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 80/160] 10.222.0.82 () {58 vars in 1275 bytes} [Wed Aug 24 03:53:06 2022] GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b/os-interface => generated 285 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:53:06.871897 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-e8c87103-141b-4b30-9ffa-a7a462bfdf42 req-1d263ff9-edc3-4fbd-a8a0-62e55ffdbc79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0aa2d996-08d6-46ce-b978-5de69b34a0f6", "tag": "857c15de-4f2d-494e-a54d-e21ae0588263"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:06.881932 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-e8c87103-141b-4b30-9ffa-a7a462bfdf42 req-1d263ff9-edc3-4fbd-a8a0-62e55ffdbc79 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:06.882410 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-e8c87103-141b-4b30-9ffa-a7a462bfdf42 req-1d263ff9-edc3-4fbd-a8a0-62e55ffdbc79 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:06.883085 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-e8c87103-141b-4b30-9ffa-a7a462bfdf42 req-1d263ff9-edc3-4fbd-a8a0-62e55ffdbc79 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:06.904369 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-e8c87103-141b-4b30-9ffa-a7a462bfdf42 req-1d263ff9-edc3-4fbd-a8a0-62e55ffdbc79 service nova] Creating event network-changed:857c15de-4f2d-494e-a54d-e21ae0588263 for instance 0aa2d996-08d6-46ce-b978-5de69b34a0f6 on hv-cinder-85426 Aug 24 03:53:06.912987 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-e8c87103-141b-4b30-9ffa-a7a462bfdf42 req-1d263ff9-edc3-4fbd-a8a0-62e55ffdbc79 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045147 Aug 24 03:53:06.918762 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 81/161] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:53:07.241875 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-c9e9e271-333e-4f45-ab2d-b597e9aa6e7e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:07.242490 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-c9e9e271-333e-4f45-ab2d-b597e9aa6e7e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:07.252641 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c9e9e271-333e-4f45-ab2d-b597e9aa6e7e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:07.253707 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c9e9e271-333e-4f45-ab2d-b597e9aa6e7e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:07.254029 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c9e9e271-333e-4f45-ab2d-b597e9aa6e7e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:07.276184 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c9e9e271-333e-4f45-ab2d-b597e9aa6e7e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:07.276184 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c9e9e271-333e-4f45-ab2d-b597e9aa6e7e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:07.276184 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c9e9e271-333e-4f45-ab2d-b597e9aa6e7e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:07.492746 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-c9e9e271-333e-4f45-ab2d-b597e9aa6e7e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:07.508671 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-c9e9e271-333e-4f45-ab2d-b597e9aa6e7e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.270965 Aug 24 03:53:07.510680 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 81/162] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:07 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:08.534358 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-24943a6b-8c2a-4fa8-bb5d-52430a7a7850 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:08.535714 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-24943a6b-8c2a-4fa8-bb5d-52430a7a7850 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:08.543798 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-24943a6b-8c2a-4fa8-bb5d-52430a7a7850 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:08.544353 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-24943a6b-8c2a-4fa8-bb5d-52430a7a7850 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:08.546242 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-24943a6b-8c2a-4fa8-bb5d-52430a7a7850 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:08.546242 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-24943a6b-8c2a-4fa8-bb5d-52430a7a7850 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:08.546242 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-24943a6b-8c2a-4fa8-bb5d-52430a7a7850 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:08.546528 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-24943a6b-8c2a-4fa8-bb5d-52430a7a7850 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:08.650930 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-631e7621-1783-45ca-a6f4-bc80538e451c req-e30df9cc-c55c-42e9-8fbc-8ea7b71ceee5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd0bdd49-e4b5-4819-91f5-399d77f4dd4b", "tag": "b3a05365-20ef-4b17-b002-533b96739ce0"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:08.663957 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-631e7621-1783-45ca-a6f4-bc80538e451c req-e30df9cc-c55c-42e9-8fbc-8ea7b71ceee5 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:08.664728 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-631e7621-1783-45ca-a6f4-bc80538e451c req-e30df9cc-c55c-42e9-8fbc-8ea7b71ceee5 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:08.665305 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-631e7621-1783-45ca-a6f4-bc80538e451c req-e30df9cc-c55c-42e9-8fbc-8ea7b71ceee5 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:08.685456 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-631e7621-1783-45ca-a6f4-bc80538e451c req-e30df9cc-c55c-42e9-8fbc-8ea7b71ceee5 service nova] Creating event network-changed:b3a05365-20ef-4b17-b002-533b96739ce0 for instance dd0bdd49-e4b5-4819-91f5-399d77f4dd4b on hv-cinder-85426 Aug 24 03:53:08.693498 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-631e7621-1783-45ca-a6f4-bc80538e451c req-e30df9cc-c55c-42e9-8fbc-8ea7b71ceee5 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047835 Aug 24 03:53:08.696072 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 82/163] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:53:08.853986 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-24943a6b-8c2a-4fa8-bb5d-52430a7a7850 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:08.869853 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-24943a6b-8c2a-4fa8-bb5d-52430a7a7850 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.339899 Aug 24 03:53:08.872418 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 82/164] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:08 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:09.899066 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-a3e4b868-2241-4f8b-a334-f6bffe70764b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:09.899824 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-a3e4b868-2241-4f8b-a334-f6bffe70764b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:09.916407 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a3e4b868-2241-4f8b-a334-f6bffe70764b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:09.916894 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a3e4b868-2241-4f8b-a334-f6bffe70764b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:09.917321 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a3e4b868-2241-4f8b-a334-f6bffe70764b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:09.918011 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a3e4b868-2241-4f8b-a334-f6bffe70764b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:09.919166 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a3e4b868-2241-4f8b-a334-f6bffe70764b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:09.919589 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a3e4b868-2241-4f8b-a334-f6bffe70764b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:10.099511 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-a3e4b868-2241-4f8b-a334-f6bffe70764b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:10.107964 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-a3e4b868-2241-4f8b-a334-f6bffe70764b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.214901 Aug 24 03:53:10.108552 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 83/165] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:09 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:11.129782 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-efc0205b-2929-4d05-ae6e-98bdb68f0f53 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:11.130549 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-efc0205b-2929-4d05-ae6e-98bdb68f0f53 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:11.137258 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-efc0205b-2929-4d05-ae6e-98bdb68f0f53 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:11.137739 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-efc0205b-2929-4d05-ae6e-98bdb68f0f53 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:11.138177 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-efc0205b-2929-4d05-ae6e-98bdb68f0f53 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:11.138910 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-efc0205b-2929-4d05-ae6e-98bdb68f0f53 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:11.139364 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-efc0205b-2929-4d05-ae6e-98bdb68f0f53 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:11.139790 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-efc0205b-2929-4d05-ae6e-98bdb68f0f53 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:11.270843 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-efc0205b-2929-4d05-ae6e-98bdb68f0f53 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:11.278851 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-efc0205b-2929-4d05-ae6e-98bdb68f0f53 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.153362 Aug 24 03:53:11.279410 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 83/166] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:11 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:12.300908 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-3e410763-2808-45ac-8c66-e6651953d720 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:12.301509 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-3e410763-2808-45ac-8c66-e6651953d720 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:12.307528 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3e410763-2808-45ac-8c66-e6651953d720 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:12.308007 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3e410763-2808-45ac-8c66-e6651953d720 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:12.308438 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3e410763-2808-45ac-8c66-e6651953d720 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:12.309115 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3e410763-2808-45ac-8c66-e6651953d720 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:12.309563 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3e410763-2808-45ac-8c66-e6651953d720 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:12.309978 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3e410763-2808-45ac-8c66-e6651953d720 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:12.444112 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-3e410763-2808-45ac-8c66-e6651953d720 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:12.451805 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-3e410763-2808-45ac-8c66-e6651953d720 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.155537 Aug 24 03:53:12.452362 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 84/167] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:12 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:13.472841 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a4e29e24-0fef-44c3-b3db-0462854c1f8b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:13.473386 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a4e29e24-0fef-44c3-b3db-0462854c1f8b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:13.479929 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a4e29e24-0fef-44c3-b3db-0462854c1f8b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:13.480443 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a4e29e24-0fef-44c3-b3db-0462854c1f8b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:13.480878 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a4e29e24-0fef-44c3-b3db-0462854c1f8b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:13.481588 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a4e29e24-0fef-44c3-b3db-0462854c1f8b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:13.482032 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a4e29e24-0fef-44c3-b3db-0462854c1f8b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:13.482450 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a4e29e24-0fef-44c3-b3db-0462854c1f8b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:13.626938 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-a4e29e24-0fef-44c3-b3db-0462854c1f8b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:13.636307 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a4e29e24-0fef-44c3-b3db-0462854c1f8b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.167561 Aug 24 03:53:13.636885 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 84/168] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:13 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:14.656938 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-ddcd4904-900a-412c-8b98-3b409922fdeb tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:14.657566 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-ddcd4904-900a-412c-8b98-3b409922fdeb tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:14.664236 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ddcd4904-900a-412c-8b98-3b409922fdeb tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:14.664725 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ddcd4904-900a-412c-8b98-3b409922fdeb tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:14.665176 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ddcd4904-900a-412c-8b98-3b409922fdeb tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:14.665990 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ddcd4904-900a-412c-8b98-3b409922fdeb tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:14.666486 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ddcd4904-900a-412c-8b98-3b409922fdeb tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:14.666974 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ddcd4904-900a-412c-8b98-3b409922fdeb tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:14.800644 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-ddcd4904-900a-412c-8b98-3b409922fdeb tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:14.804332 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:14.808887 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-ddcd4904-900a-412c-8b98-3b409922fdeb tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.155720 Aug 24 03:53:14.809463 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 85/169] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:14 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:15.830163 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e7347df5-37f5-49d1-a2d9-c74b518e9ae2 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:15.830786 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e7347df5-37f5-49d1-a2d9-c74b518e9ae2 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:15.838256 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7347df5-37f5-49d1-a2d9-c74b518e9ae2 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:15.838826 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7347df5-37f5-49d1-a2d9-c74b518e9ae2 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:15.839317 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7347df5-37f5-49d1-a2d9-c74b518e9ae2 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:15.843958 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7347df5-37f5-49d1-a2d9-c74b518e9ae2 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:15.843958 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7347df5-37f5-49d1-a2d9-c74b518e9ae2 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:15.843958 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7347df5-37f5-49d1-a2d9-c74b518e9ae2 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:15.980274 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-e7347df5-37f5-49d1-a2d9-c74b518e9ae2 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:15.988144 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e7347df5-37f5-49d1-a2d9-c74b518e9ae2 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.161719 Aug 24 03:53:15.988696 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 85/170] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:15 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:17.008874 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-a2e854e5-b10b-4f02-af0a-8c745122c072 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:17.009546 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-a2e854e5-b10b-4f02-af0a-8c745122c072 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:17.016527 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a2e854e5-b10b-4f02-af0a-8c745122c072 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:17.017011 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a2e854e5-b10b-4f02-af0a-8c745122c072 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:17.017447 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a2e854e5-b10b-4f02-af0a-8c745122c072 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:17.018166 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a2e854e5-b10b-4f02-af0a-8c745122c072 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:17.018768 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a2e854e5-b10b-4f02-af0a-8c745122c072 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:17.019368 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a2e854e5-b10b-4f02-af0a-8c745122c072 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:17.163540 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-a2e854e5-b10b-4f02-af0a-8c745122c072 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:17.172162 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-a2e854e5-b10b-4f02-af0a-8c745122c072 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.167285 Aug 24 03:53:17.172959 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 86/171] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:17 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:18.199902 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8c9047c0-919d-4794-85fa-9068cac0b314 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:18.200517 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8c9047c0-919d-4794-85fa-9068cac0b314 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:18.209713 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c9047c0-919d-4794-85fa-9068cac0b314 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:18.210222 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c9047c0-919d-4794-85fa-9068cac0b314 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:18.210685 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c9047c0-919d-4794-85fa-9068cac0b314 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:18.211378 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c9047c0-919d-4794-85fa-9068cac0b314 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:18.211823 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c9047c0-919d-4794-85fa-9068cac0b314 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:18.212235 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c9047c0-919d-4794-85fa-9068cac0b314 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:18.355694 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-8c9047c0-919d-4794-85fa-9068cac0b314 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:18.364114 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8c9047c0-919d-4794-85fa-9068cac0b314 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.168600 Aug 24 03:53:18.364687 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 86/172] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:18 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:19.385527 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-89aa10cf-701a-4511-bd6d-28336877b77c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:19.386121 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-89aa10cf-701a-4511-bd6d-28336877b77c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:19.392795 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-89aa10cf-701a-4511-bd6d-28336877b77c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:19.393263 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-89aa10cf-701a-4511-bd6d-28336877b77c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:19.393739 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-89aa10cf-701a-4511-bd6d-28336877b77c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:19.394440 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-89aa10cf-701a-4511-bd6d-28336877b77c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:19.394865 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-89aa10cf-701a-4511-bd6d-28336877b77c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:19.395278 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-89aa10cf-701a-4511-bd6d-28336877b77c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:19.526407 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-89aa10cf-701a-4511-bd6d-28336877b77c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:19.534350 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-89aa10cf-701a-4511-bd6d-28336877b77c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.152746 Aug 24 03:53:19.534999 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 87/173] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:19 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:20.555332 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6182cf96-07de-4add-9e95-1ef8fc7fa48f tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:20.555970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6182cf96-07de-4add-9e95-1ef8fc7fa48f tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:20.563141 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6182cf96-07de-4add-9e95-1ef8fc7fa48f tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:20.563620 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6182cf96-07de-4add-9e95-1ef8fc7fa48f tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:20.564054 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6182cf96-07de-4add-9e95-1ef8fc7fa48f tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:20.564735 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6182cf96-07de-4add-9e95-1ef8fc7fa48f tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:20.565185 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6182cf96-07de-4add-9e95-1ef8fc7fa48f tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:20.565605 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6182cf96-07de-4add-9e95-1ef8fc7fa48f tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:20.698102 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-6182cf96-07de-4add-9e95-1ef8fc7fa48f tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:20.708693 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6182cf96-07de-4add-9e95-1ef8fc7fa48f tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.157283 Aug 24 03:53:20.709284 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 87/174] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:20 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:21.495979 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-70795c68-c549-42ff-9ab4-f36b6545d51a tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:21.496524 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-70795c68-c549-42ff-9ab4-f36b6545d51a tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] [instance: 0090ef1a-b99b-4032-834a-bfa5d112dfc5] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:21.502620 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-70795c68-c549-42ff-9ab4-f36b6545d51a tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:21.503108 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-70795c68-c549-42ff-9ab4-f36b6545d51a tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:21.503579 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-70795c68-c549-42ff-9ab4-f36b6545d51a tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:21.504311 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-70795c68-c549-42ff-9ab4-f36b6545d51a tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:21.504763 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-70795c68-c549-42ff-9ab4-f36b6545d51a tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:21.505189 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-70795c68-c549-42ff-9ab4-f36b6545d51a tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:21.531921 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-70795c68-c549-42ff-9ab4-f36b6545d51a tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] [instance: 0090ef1a-b99b-4032-834a-bfa5d112dfc5] Going to try to terminate instance {{(pid=127869) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:53:21.729882 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-68681520-d2a6-4349-810e-9c4e03f65a91 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:21.730651 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-68681520-d2a6-4349-810e-9c4e03f65a91 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:21.737155 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-68681520-d2a6-4349-810e-9c4e03f65a91 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:21.737631 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-68681520-d2a6-4349-810e-9c4e03f65a91 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:21.738063 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-68681520-d2a6-4349-810e-9c4e03f65a91 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:21.738815 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-68681520-d2a6-4349-810e-9c4e03f65a91 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:21.739263 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-68681520-d2a6-4349-810e-9c4e03f65a91 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:21.739682 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-68681520-d2a6-4349-810e-9c4e03f65a91 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:21.849761 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-70795c68-c549-42ff-9ab4-f36b6545d51a tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] 10.222.0.82 "DELETE /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5" status: 204 len: 0 microversion: 2.1 time: 0.357360 Aug 24 03:53:21.851093 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 88/175] 10.222.0.82 () {58 vars in 1239 bytes} [Wed Aug 24 03:53:21 2022] DELETE /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:53:21.859521 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-26b3eea7-a317-44ca-a66d-055ee76ae6b3 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:21.860350 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-26b3eea7-a317-44ca-a66d-055ee76ae6b3 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] [instance: 0090ef1a-b99b-4032-834a-bfa5d112dfc5] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:21.866848 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-26b3eea7-a317-44ca-a66d-055ee76ae6b3 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:21.867364 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-26b3eea7-a317-44ca-a66d-055ee76ae6b3 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:21.867794 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-26b3eea7-a317-44ca-a66d-055ee76ae6b3 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:21.868657 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-26b3eea7-a317-44ca-a66d-055ee76ae6b3 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:21.869110 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-26b3eea7-a317-44ca-a66d-055ee76ae6b3 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:21.869530 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-26b3eea7-a317-44ca-a66d-055ee76ae6b3 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:21.879489 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-68681520-d2a6-4349-810e-9c4e03f65a91 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:21.883788 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:21.888357 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-68681520-d2a6-4349-810e-9c4e03f65a91 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.163115 Aug 24 03:53:21.888930 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 88/176] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:21 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:22.005791 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-26b3eea7-a317-44ca-a66d-055ee76ae6b3 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466f40eba2a4975bd13614474ff527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649f222d62844debb70df5ed5e8d44ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:22.014519 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-26b3eea7-a317-44ca-a66d-055ee76ae6b3 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] 10.222.0.82 "GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5" status: 200 len: 1553 microversion: 2.1 time: 0.159062 Aug 24 03:53:22.015088 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 89/177] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:21 2022] GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5 => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:22.910879 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0b01d9df-06ac-45b2-a58f-d3ad30d91a42 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:22.911626 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0b01d9df-06ac-45b2-a58f-d3ad30d91a42 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:22.919455 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0b01d9df-06ac-45b2-a58f-d3ad30d91a42 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:22.919939 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0b01d9df-06ac-45b2-a58f-d3ad30d91a42 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:22.920372 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0b01d9df-06ac-45b2-a58f-d3ad30d91a42 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:22.921337 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0b01d9df-06ac-45b2-a58f-d3ad30d91a42 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:22.923446 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0b01d9df-06ac-45b2-a58f-d3ad30d91a42 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:22.923446 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0b01d9df-06ac-45b2-a58f-d3ad30d91a42 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:23.035953 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-6fb9b65d-fa75-47b4-8bad-411395fa5acb tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:23.036563 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-6fb9b65d-fa75-47b4-8bad-411395fa5acb tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] [instance: 0090ef1a-b99b-4032-834a-bfa5d112dfc5] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:23.043042 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6fb9b65d-fa75-47b4-8bad-411395fa5acb tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:23.043581 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6fb9b65d-fa75-47b4-8bad-411395fa5acb tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:23.044014 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6fb9b65d-fa75-47b4-8bad-411395fa5acb tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:23.044695 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6fb9b65d-fa75-47b4-8bad-411395fa5acb tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:23.045139 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6fb9b65d-fa75-47b4-8bad-411395fa5acb tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:23.045553 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6fb9b65d-fa75-47b4-8bad-411395fa5acb tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:23.060684 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-0b01d9df-06ac-45b2-a58f-d3ad30d91a42 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:23.068707 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0b01d9df-06ac-45b2-a58f-d3ad30d91a42 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.161992 Aug 24 03:53:23.069629 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 89/178] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:22 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:23.182759 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-6fb9b65d-fa75-47b4-8bad-411395fa5acb tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466f40eba2a4975bd13614474ff527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649f222d62844debb70df5ed5e8d44ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:23.191552 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-6fb9b65d-fa75-47b4-8bad-411395fa5acb tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] 10.222.0.82 "GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5" status: 200 len: 1553 microversion: 2.1 time: 0.159388 Aug 24 03:53:23.192124 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 90/179] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:23 2022] GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5 => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:24.089787 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0d8f9758-545f-434d-b963-f7942821e27d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:24.090350 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0d8f9758-545f-434d-b963-f7942821e27d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:24.096873 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0d8f9758-545f-434d-b963-f7942821e27d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:24.097411 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0d8f9758-545f-434d-b963-f7942821e27d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:24.097962 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0d8f9758-545f-434d-b963-f7942821e27d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:24.098708 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0d8f9758-545f-434d-b963-f7942821e27d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:24.099168 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0d8f9758-545f-434d-b963-f7942821e27d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:24.099595 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0d8f9758-545f-434d-b963-f7942821e27d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:24.213116 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-4bc592e4-16cc-4c2c-b3d8-89422963099d tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:24.213899 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-4bc592e4-16cc-4c2c-b3d8-89422963099d tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] [instance: 0090ef1a-b99b-4032-834a-bfa5d112dfc5] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:24.219896 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4bc592e4-16cc-4c2c-b3d8-89422963099d tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:24.220381 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4bc592e4-16cc-4c2c-b3d8-89422963099d tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:24.221993 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4bc592e4-16cc-4c2c-b3d8-89422963099d tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:24.221993 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4bc592e4-16cc-4c2c-b3d8-89422963099d tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:24.221993 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4bc592e4-16cc-4c2c-b3d8-89422963099d tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:24.222325 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4bc592e4-16cc-4c2c-b3d8-89422963099d tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:24.236567 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-0d8f9758-545f-434d-b963-f7942821e27d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:24.246828 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0d8f9758-545f-434d-b963-f7942821e27d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.160482 Aug 24 03:53:24.248281 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 90/180] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:24 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:24.357391 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-4bc592e4-16cc-4c2c-b3d8-89422963099d tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466f40eba2a4975bd13614474ff527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649f222d62844debb70df5ed5e8d44ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:24.366690 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-4bc592e4-16cc-4c2c-b3d8-89422963099d tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] 10.222.0.82 "GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5" status: 200 len: 1553 microversion: 2.1 time: 0.158047 Aug 24 03:53:24.367268 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 91/181] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:24 2022] GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5 => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:25.280155 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-aae67f39-c9dc-4edb-859f-41e1e3440b2e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:25.280714 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-aae67f39-c9dc-4edb-859f-41e1e3440b2e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:25.288445 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aae67f39-c9dc-4edb-859f-41e1e3440b2e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:25.288918 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aae67f39-c9dc-4edb-859f-41e1e3440b2e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:25.289348 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aae67f39-c9dc-4edb-859f-41e1e3440b2e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:25.290029 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aae67f39-c9dc-4edb-859f-41e1e3440b2e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:25.290478 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aae67f39-c9dc-4edb-859f-41e1e3440b2e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:25.290921 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aae67f39-c9dc-4edb-859f-41e1e3440b2e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:25.387630 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-9803b73b-59db-432f-aa1c-f8d9f03baaaa tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:25.388241 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-9803b73b-59db-432f-aa1c-f8d9f03baaaa tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] [instance: 0090ef1a-b99b-4032-834a-bfa5d112dfc5] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:25.394554 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9803b73b-59db-432f-aa1c-f8d9f03baaaa tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:25.399729 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9803b73b-59db-432f-aa1c-f8d9f03baaaa tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:25.399729 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9803b73b-59db-432f-aa1c-f8d9f03baaaa tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:25.399729 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9803b73b-59db-432f-aa1c-f8d9f03baaaa tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:25.399729 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9803b73b-59db-432f-aa1c-f8d9f03baaaa tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:25.400103 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9803b73b-59db-432f-aa1c-f8d9f03baaaa tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:25.482916 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-9803b73b-59db-432f-aa1c-f8d9f03baaaa tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466f40eba2a4975bd13614474ff527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649f222d62844debb70df5ed5e8d44ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:25.493540 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-9803b73b-59db-432f-aa1c-f8d9f03baaaa tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] 10.222.0.82 "GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5" status: 200 len: 1511 microversion: 2.1 time: 0.109769 Aug 24 03:53:25.494372 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 92/182] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:25 2022] GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5 => generated 1511 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:25.499236 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-5ec5da07-9bef-483f-9664-65df13739270 req-af112137-a86b-437d-913e-ed09e795cbe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0090ef1a-b99b-4032-834a-bfa5d112dfc5", "name": "network-vif-deleted", "tag": "47bc5ad1-6e46-4623-a885-45a6a50611df"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:25.510022 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-5ec5da07-9bef-483f-9664-65df13739270 req-af112137-a86b-437d-913e-ed09e795cbe7 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:25.510492 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-5ec5da07-9bef-483f-9664-65df13739270 req-af112137-a86b-437d-913e-ed09e795cbe7 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:25.510938 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-5ec5da07-9bef-483f-9664-65df13739270 req-af112137-a86b-437d-913e-ed09e795cbe7 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:25.525437 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-5ec5da07-9bef-483f-9664-65df13739270 req-af112137-a86b-437d-913e-ed09e795cbe7 service nova] Creating event network-vif-deleted:47bc5ad1-6e46-4623-a885-45a6a50611df for instance 0090ef1a-b99b-4032-834a-bfa5d112dfc5 on hv-cinder-85426 Aug 24 03:53:25.529359 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-aae67f39-c9dc-4edb-859f-41e1e3440b2e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:25.533342 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-5ec5da07-9bef-483f-9664-65df13739270 req-af112137-a86b-437d-913e-ed09e795cbe7 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034782 Aug 24 03:53:25.533342 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 93/183] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:53:25.538863 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-aae67f39-c9dc-4edb-859f-41e1e3440b2e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.262676 Aug 24 03:53:25.539680 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 91/184] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:25 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:26.517434 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-06721ee0-9be9-4c76-832e-5ccdccbf621f tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:26.518131 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-06721ee0-9be9-4c76-832e-5ccdccbf621f tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] [instance: 0090ef1a-b99b-4032-834a-bfa5d112dfc5] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:26.524990 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-06721ee0-9be9-4c76-832e-5ccdccbf621f tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:26.525470 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-06721ee0-9be9-4c76-832e-5ccdccbf621f tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:26.526152 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-06721ee0-9be9-4c76-832e-5ccdccbf621f tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:26.526866 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-06721ee0-9be9-4c76-832e-5ccdccbf621f tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:26.527323 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-06721ee0-9be9-4c76-832e-5ccdccbf621f tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:26.527737 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-06721ee0-9be9-4c76-832e-5ccdccbf621f tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:26.559390 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9e7fcfea-16b3-4e87-b746-1fcbeeb88748 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:26.560028 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9e7fcfea-16b3-4e87-b746-1fcbeeb88748 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:26.566837 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e7fcfea-16b3-4e87-b746-1fcbeeb88748 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:26.567436 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e7fcfea-16b3-4e87-b746-1fcbeeb88748 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:26.568078 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e7fcfea-16b3-4e87-b746-1fcbeeb88748 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:26.569381 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e7fcfea-16b3-4e87-b746-1fcbeeb88748 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:26.569834 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e7fcfea-16b3-4e87-b746-1fcbeeb88748 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:26.570259 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e7fcfea-16b3-4e87-b746-1fcbeeb88748 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:26.593150 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-06721ee0-9be9-4c76-832e-5ccdccbf621f tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466f40eba2a4975bd13614474ff527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649f222d62844debb70df5ed5e8d44ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:26.602026 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-06721ee0-9be9-4c76-832e-5ccdccbf621f tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] 10.222.0.82 "GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5" status: 200 len: 1511 microversion: 2.1 time: 0.088752 Aug 24 03:53:26.602616 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 94/185] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:26 2022] GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5 => generated 1511 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:26.702881 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-9e7fcfea-16b3-4e87-b746-1fcbeeb88748 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:26.710736 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9e7fcfea-16b3-4e87-b746-1fcbeeb88748 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.155073 Aug 24 03:53:26.711303 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 92/186] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:26 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:27.623364 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-ab3994c9-3180-4f5f-8c2c-8ecc3da21af1 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:27.623971 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-ab3994c9-3180-4f5f-8c2c-8ecc3da21af1 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] [instance: 0090ef1a-b99b-4032-834a-bfa5d112dfc5] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:27.630071 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ab3994c9-3180-4f5f-8c2c-8ecc3da21af1 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:27.630574 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ab3994c9-3180-4f5f-8c2c-8ecc3da21af1 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:27.631120 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ab3994c9-3180-4f5f-8c2c-8ecc3da21af1 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:27.631824 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ab3994c9-3180-4f5f-8c2c-8ecc3da21af1 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:27.632388 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ab3994c9-3180-4f5f-8c2c-8ecc3da21af1 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:27.632809 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ab3994c9-3180-4f5f-8c2c-8ecc3da21af1 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:27.696363 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-ab3994c9-3180-4f5f-8c2c-8ecc3da21af1 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466f40eba2a4975bd13614474ff527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649f222d62844debb70df5ed5e8d44ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:27.704561 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-ab3994c9-3180-4f5f-8c2c-8ecc3da21af1 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] 10.222.0.82 "GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5" status: 200 len: 1511 microversion: 2.1 time: 0.085000 Aug 24 03:53:27.705119 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 95/187] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:27 2022] GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5 => generated 1511 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:27.734692 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b0671e16-62ad-411a-a0e1-a1c48a697010 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:27.735826 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b0671e16-62ad-411a-a0e1-a1c48a697010 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:27.747694 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b0671e16-62ad-411a-a0e1-a1c48a697010 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:27.748576 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b0671e16-62ad-411a-a0e1-a1c48a697010 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:27.749099 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b0671e16-62ad-411a-a0e1-a1c48a697010 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:27.750394 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b0671e16-62ad-411a-a0e1-a1c48a697010 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:27.751281 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b0671e16-62ad-411a-a0e1-a1c48a697010 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:27.752076 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b0671e16-62ad-411a-a0e1-a1c48a697010 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:27.886427 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-b0671e16-62ad-411a-a0e1-a1c48a697010 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:27.894177 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b0671e16-62ad-411a-a0e1-a1c48a697010 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.165667 Aug 24 03:53:27.894788 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 93/188] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:27 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:28.726153 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-ce421b04-6723-4f8a-bd58-3932431f84f2 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:28.726796 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-ce421b04-6723-4f8a-bd58-3932431f84f2 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] [instance: 0090ef1a-b99b-4032-834a-bfa5d112dfc5] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:28.732698 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ce421b04-6723-4f8a-bd58-3932431f84f2 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:28.733151 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ce421b04-6723-4f8a-bd58-3932431f84f2 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:28.733586 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ce421b04-6723-4f8a-bd58-3932431f84f2 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:28.734266 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ce421b04-6723-4f8a-bd58-3932431f84f2 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:28.734742 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ce421b04-6723-4f8a-bd58-3932431f84f2 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:28.735166 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ce421b04-6723-4f8a-bd58-3932431f84f2 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:28.796136 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-ce421b04-6723-4f8a-bd58-3932431f84f2 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466f40eba2a4975bd13614474ff527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649f222d62844debb70df5ed5e8d44ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:28.805423 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-ce421b04-6723-4f8a-bd58-3932431f84f2 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] 10.222.0.82 "GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5" status: 200 len: 1346 microversion: 2.1 time: 0.083630 Aug 24 03:53:28.805983 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 96/189] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:28 2022] GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5 => generated 1346 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:28.916050 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7513f32e-10e9-4c75-bb02-0984026a60e3 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:28.916658 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7513f32e-10e9-4c75-bb02-0984026a60e3 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:28.922565 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7513f32e-10e9-4c75-bb02-0984026a60e3 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:28.923049 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7513f32e-10e9-4c75-bb02-0984026a60e3 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:28.923489 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7513f32e-10e9-4c75-bb02-0984026a60e3 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:28.924172 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7513f32e-10e9-4c75-bb02-0984026a60e3 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:28.924626 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7513f32e-10e9-4c75-bb02-0984026a60e3 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:28.925048 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7513f32e-10e9-4c75-bb02-0984026a60e3 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:29.057375 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-7513f32e-10e9-4c75-bb02-0984026a60e3 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:29.069121 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7513f32e-10e9-4c75-bb02-0984026a60e3 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.153971 Aug 24 03:53:29.069121 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 94/190] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:28 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:29.825466 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-66cc19c4-c8ac-4595-b565-6bbf80bde566 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:29.826219 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-66cc19c4-c8ac-4595-b565-6bbf80bde566 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] [instance: 0090ef1a-b99b-4032-834a-bfa5d112dfc5] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:29.832107 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-66cc19c4-c8ac-4595-b565-6bbf80bde566 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:29.832601 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-66cc19c4-c8ac-4595-b565-6bbf80bde566 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:29.837286 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-66cc19c4-c8ac-4595-b565-6bbf80bde566 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:29.837286 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-66cc19c4-c8ac-4595-b565-6bbf80bde566 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:29.837286 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-66cc19c4-c8ac-4595-b565-6bbf80bde566 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:29.837286 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-66cc19c4-c8ac-4595-b565-6bbf80bde566 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:29.896025 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-66cc19c4-c8ac-4595-b565-6bbf80bde566 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466f40eba2a4975bd13614474ff527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649f222d62844debb70df5ed5e8d44ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:29.904997 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-66cc19c4-c8ac-4595-b565-6bbf80bde566 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] 10.222.0.82 "GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5" status: 200 len: 1346 microversion: 2.1 time: 0.083418 Aug 24 03:53:29.905556 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 97/191] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:29 2022] GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5 => generated 1346 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:30.087994 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-919ee62f-d277-44e1-aac8-494774fb6bb7 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:30.088515 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-919ee62f-d277-44e1-aac8-494774fb6bb7 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:30.095436 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-919ee62f-d277-44e1-aac8-494774fb6bb7 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:30.096265 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-919ee62f-d277-44e1-aac8-494774fb6bb7 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:30.096985 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-919ee62f-d277-44e1-aac8-494774fb6bb7 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:30.097668 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-919ee62f-d277-44e1-aac8-494774fb6bb7 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:30.098158 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-919ee62f-d277-44e1-aac8-494774fb6bb7 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:30.099159 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-919ee62f-d277-44e1-aac8-494774fb6bb7 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:30.234770 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-919ee62f-d277-44e1-aac8-494774fb6bb7 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:30.243646 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-919ee62f-d277-44e1-aac8-494774fb6bb7 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.159753 Aug 24 03:53:30.244222 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 95/192] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:30 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:30.925419 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-ebeeb541-3ce9-4c16-b55d-e8dab40ba872 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:30.926033 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-ebeeb541-3ce9-4c16-b55d-e8dab40ba872 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] [instance: 0090ef1a-b99b-4032-834a-bfa5d112dfc5] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:30.932246 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ebeeb541-3ce9-4c16-b55d-e8dab40ba872 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:30.932726 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ebeeb541-3ce9-4c16-b55d-e8dab40ba872 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:30.933157 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ebeeb541-3ce9-4c16-b55d-e8dab40ba872 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:30.933911 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ebeeb541-3ce9-4c16-b55d-e8dab40ba872 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:30.934360 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ebeeb541-3ce9-4c16-b55d-e8dab40ba872 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:30.934809 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ebeeb541-3ce9-4c16-b55d-e8dab40ba872 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:30.966287 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ebeeb541-3ce9-4c16-b55d-e8dab40ba872 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:30.966795 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ebeeb541-3ce9-4c16-b55d-e8dab40ba872 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:30.967222 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ebeeb541-3ce9-4c16-b55d-e8dab40ba872 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:30.967661 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.objects.instance [None req-ebeeb541-3ce9-4c16-b55d-e8dab40ba872 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lazy-loading 'fault' on Instance uuid 0090ef1a-b99b-4032-834a-bfa5d112dfc5 {{(pid=127869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:53:31.013625 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-ebeeb541-3ce9-4c16-b55d-e8dab40ba872 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466f40eba2a4975bd13614474ff527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649f222d62844debb70df5ed5e8d44ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:31.022040 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-ebeeb541-3ce9-4c16-b55d-e8dab40ba872 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] 10.222.0.82 "GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5" status: 200 len: 1351 microversion: 2.1 time: 0.100373 Aug 24 03:53:31.022416 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 98/193] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:30 2022] GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5 => generated 1351 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:31.266157 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-30e978d5-1097-44c4-bf4f-949d24bcc8a9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:31.266722 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-30e978d5-1097-44c4-bf4f-949d24bcc8a9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:31.273347 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-30e978d5-1097-44c4-bf4f-949d24bcc8a9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:31.274743 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-30e978d5-1097-44c4-bf4f-949d24bcc8a9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:31.275621 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-30e978d5-1097-44c4-bf4f-949d24bcc8a9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:31.276350 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-30e978d5-1097-44c4-bf4f-949d24bcc8a9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:31.276793 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-30e978d5-1097-44c4-bf4f-949d24bcc8a9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:31.277233 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-30e978d5-1097-44c4-bf4f-949d24bcc8a9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:31.405591 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-30e978d5-1097-44c4-bf4f-949d24bcc8a9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:31.413326 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-30e978d5-1097-44c4-bf4f-949d24bcc8a9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.151330 Aug 24 03:53:31.413893 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 96/194] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:31 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:32.043519 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-5560b410-5c0c-4bfe-99c1-62a1b9e782d9 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:32.044122 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-5560b410-5c0c-4bfe-99c1-62a1b9e782d9 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] [instance: 0090ef1a-b99b-4032-834a-bfa5d112dfc5] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:32.046138 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:32.050783 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5560b410-5c0c-4bfe-99c1-62a1b9e782d9 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:32.051294 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5560b410-5c0c-4bfe-99c1-62a1b9e782d9 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:32.051720 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5560b410-5c0c-4bfe-99c1-62a1b9e782d9 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:32.052396 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5560b410-5c0c-4bfe-99c1-62a1b9e782d9 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:32.052842 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5560b410-5c0c-4bfe-99c1-62a1b9e782d9 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:32.053257 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5560b410-5c0c-4bfe-99c1-62a1b9e782d9 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:32.084113 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5560b410-5c0c-4bfe-99c1-62a1b9e782d9 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:32.084506 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5560b410-5c0c-4bfe-99c1-62a1b9e782d9 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:32.084938 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5560b410-5c0c-4bfe-99c1-62a1b9e782d9 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:32.085373 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.objects.instance [None req-5560b410-5c0c-4bfe-99c1-62a1b9e782d9 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lazy-loading 'fault' on Instance uuid 0090ef1a-b99b-4032-834a-bfa5d112dfc5 {{(pid=127869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:53:32.127092 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-5560b410-5c0c-4bfe-99c1-62a1b9e782d9 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466f40eba2a4975bd13614474ff527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649f222d62844debb70df5ed5e8d44ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:32.135430 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-5560b410-5c0c-4bfe-99c1-62a1b9e782d9 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] 10.222.0.82 "GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5" status: 200 len: 1351 microversion: 2.1 time: 0.096427 Aug 24 03:53:32.135984 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 99/195] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:32 2022] GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5 => generated 1351 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:32.433946 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-86bd54f6-243c-45cd-be86-ae24d0497500 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:32.434594 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-86bd54f6-243c-45cd-be86-ae24d0497500 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:32.441190 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-86bd54f6-243c-45cd-be86-ae24d0497500 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:32.441670 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-86bd54f6-243c-45cd-be86-ae24d0497500 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:32.442108 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-86bd54f6-243c-45cd-be86-ae24d0497500 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:32.442938 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-86bd54f6-243c-45cd-be86-ae24d0497500 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:32.443394 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-86bd54f6-243c-45cd-be86-ae24d0497500 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:32.443813 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-86bd54f6-243c-45cd-be86-ae24d0497500 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:32.599696 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-86bd54f6-243c-45cd-be86-ae24d0497500 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:32.610191 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-86bd54f6-243c-45cd-be86-ae24d0497500 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.180245 Aug 24 03:53:32.610811 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 97/196] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:32 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:33.157221 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-f58d4b35-f57c-495d-87e9-a7299832d74b tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:33.157874 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-f58d4b35-f57c-495d-87e9-a7299832d74b tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] [instance: 0090ef1a-b99b-4032-834a-bfa5d112dfc5] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:33.164239 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f58d4b35-f57c-495d-87e9-a7299832d74b tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:33.164810 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f58d4b35-f57c-495d-87e9-a7299832d74b tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:33.165148 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f58d4b35-f57c-495d-87e9-a7299832d74b tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:33.165844 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f58d4b35-f57c-495d-87e9-a7299832d74b tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:33.166297 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f58d4b35-f57c-495d-87e9-a7299832d74b tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:33.166833 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f58d4b35-f57c-495d-87e9-a7299832d74b tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:33.199325 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f58d4b35-f57c-495d-87e9-a7299832d74b tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:33.199795 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f58d4b35-f57c-495d-87e9-a7299832d74b tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:33.200227 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f58d4b35-f57c-495d-87e9-a7299832d74b tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:33.200659 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.objects.instance [None req-f58d4b35-f57c-495d-87e9-a7299832d74b tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lazy-loading 'fault' on Instance uuid 0090ef1a-b99b-4032-834a-bfa5d112dfc5 {{(pid=127869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:53:33.203278 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:33.244118 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-f58d4b35-f57c-495d-87e9-a7299832d74b tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466f40eba2a4975bd13614474ff527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649f222d62844debb70df5ed5e8d44ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:33.251404 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-f58d4b35-f57c-495d-87e9-a7299832d74b tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] 10.222.0.82 "GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5" status: 200 len: 1351 microversion: 2.1 time: 0.099014 Aug 24 03:53:33.251983 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 100/197] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:33 2022] GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5 => generated 1351 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:33.631073 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1749151e-89a2-46d0-b32f-5bdb64ebaa96 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:33.632189 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1749151e-89a2-46d0-b32f-5bdb64ebaa96 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:33.638571 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1749151e-89a2-46d0-b32f-5bdb64ebaa96 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:33.639060 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1749151e-89a2-46d0-b32f-5bdb64ebaa96 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:33.639490 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1749151e-89a2-46d0-b32f-5bdb64ebaa96 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:33.640175 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1749151e-89a2-46d0-b32f-5bdb64ebaa96 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:33.640624 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1749151e-89a2-46d0-b32f-5bdb64ebaa96 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:33.641042 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1749151e-89a2-46d0-b32f-5bdb64ebaa96 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:33.771172 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-1749151e-89a2-46d0-b32f-5bdb64ebaa96 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:33.781365 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1749151e-89a2-46d0-b32f-5bdb64ebaa96 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.153722 Aug 24 03:53:33.782193 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 98/198] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:33 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:34.274990 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-416db7e0-58a2-4ad2-8063-452f3f1b1ade tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:34.275507 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-416db7e0-58a2-4ad2-8063-452f3f1b1ade tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] [instance: 0090ef1a-b99b-4032-834a-bfa5d112dfc5] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:34.282295 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-416db7e0-58a2-4ad2-8063-452f3f1b1ade tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:34.282815 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-416db7e0-58a2-4ad2-8063-452f3f1b1ade tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:34.283248 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-416db7e0-58a2-4ad2-8063-452f3f1b1ade tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:34.283940 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-416db7e0-58a2-4ad2-8063-452f3f1b1ade tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:34.284389 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-416db7e0-58a2-4ad2-8063-452f3f1b1ade tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:34.284811 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-416db7e0-58a2-4ad2-8063-452f3f1b1ade tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:34.317161 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-416db7e0-58a2-4ad2-8063-452f3f1b1ade tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:34.317650 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-416db7e0-58a2-4ad2-8063-452f3f1b1ade tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:34.318085 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-416db7e0-58a2-4ad2-8063-452f3f1b1ade tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:34.318569 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.objects.instance [None req-416db7e0-58a2-4ad2-8063-452f3f1b1ade tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lazy-loading 'fault' on Instance uuid 0090ef1a-b99b-4032-834a-bfa5d112dfc5 {{(pid=127869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:53:34.360855 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-416db7e0-58a2-4ad2-8063-452f3f1b1ade tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466f40eba2a4975bd13614474ff527c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649f222d62844debb70df5ed5e8d44ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:34.369885 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-416db7e0-58a2-4ad2-8063-452f3f1b1ade tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] 10.222.0.82 "GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5" status: 200 len: 1351 microversion: 2.1 time: 0.100255 Aug 24 03:53:34.370456 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 101/199] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:34 2022] GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5 => generated 1351 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:34.811461 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e9407e01-43b0-48af-a9d2-bdf82c11535c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:34.812118 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e9407e01-43b0-48af-a9d2-bdf82c11535c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:34.818472 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e9407e01-43b0-48af-a9d2-bdf82c11535c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:34.818973 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e9407e01-43b0-48af-a9d2-bdf82c11535c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:34.819409 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e9407e01-43b0-48af-a9d2-bdf82c11535c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:34.820836 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e9407e01-43b0-48af-a9d2-bdf82c11535c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:34.821303 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e9407e01-43b0-48af-a9d2-bdf82c11535c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:34.821717 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e9407e01-43b0-48af-a9d2-bdf82c11535c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:34.976946 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-e9407e01-43b0-48af-a9d2-bdf82c11535c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:34.984836 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e9407e01-43b0-48af-a9d2-bdf82c11535c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.177347 Aug 24 03:53:34.985411 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 99/200] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:34 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:35.390310 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-9fea9ab0-8787-47fa-9022-123fc65d5ea3 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:35.390950 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-9fea9ab0-8787-47fa-9022-123fc65d5ea3 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] [instance: 0090ef1a-b99b-4032-834a-bfa5d112dfc5] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:35.397499 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9fea9ab0-8787-47fa-9022-123fc65d5ea3 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:35.398536 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9fea9ab0-8787-47fa-9022-123fc65d5ea3 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:35.399030 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9fea9ab0-8787-47fa-9022-123fc65d5ea3 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:35.400000 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9fea9ab0-8787-47fa-9022-123fc65d5ea3 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:35.400473 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9fea9ab0-8787-47fa-9022-123fc65d5ea3 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:35.400979 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9fea9ab0-8787-47fa-9022-123fc65d5ea3 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:35.417355 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.wsgi [None req-9fea9ab0-8787-47fa-9022-123fc65d5ea3 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] HTTP exception thrown: Instance 0090ef1a-b99b-4032-834a-bfa5d112dfc5 could not be found. Aug 24 03:53:35.425693 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-9fea9ab0-8787-47fa-9022-123fc65d5ea3 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Request method failure captured: Aug 24 03:53:35.425693 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: request: GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5 HTTP/1.1 Aug 24 03:53:35.425693 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept: application/json Aug 24 03:53:35.425693 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept-Encoding: identity Aug 24 03:53:35.425693 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Connection: close Aug 24 03:53:35.425693 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Length: 0 Aug 24 03:53:35.425693 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Type: application/json Aug 24 03:53:35.425693 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Host: 10.222.0.82 Aug 24 03:53:35.425693 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Openstack-System-Scope: None Aug 24 03:53:35.425693 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: User-Agent: python-urllib3/1.26.11 Aug 24 03:53:35.425693 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Auth-Token: gAAAAABjBaBwwlgmGgCr0_yEKzKCnCCgG2tc8QZlQfMBbrrwL7_NLU9LU1aI51fUit1JPjRvy_WDCwd0cfpOOhG0l1tFz5TNMyfHFLUAxkZBIEwi6Zh9sZ1ugLBAyCZz2eVkDpiSCFL-p6lWCcqTgAQxFsYehmh42ws_m3sxYVdwqvKqA06rpS8 Aug 24 03:53:35.425693 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Id: None Aug 24 03:53:35.425693 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Name: None Aug 24 03:53:35.425693 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Identity-Status: Confirmed Aug 24 03:53:35.425693 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Is-Admin-Project: True Aug 24 03:53:35.425693 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Id: default Aug 24 03:53:35.425693 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Name: Default Aug 24 03:53:35.425693 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Id: 649f222d62844debb70df5ed5e8d44ad Aug 24 03:53:35.425693 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Name: tempest-DeleteServersTestJSON-237477954 Aug 24 03:53:35.425693 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Role: member,reader Aug 24 03:53:35.425693 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Roles: member,reader Aug 24 03:53:35.426917 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/649f222d62844debb70df5ed5e8d44ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/649f222d62844debb70df5ed5e8d44ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/649f222d62844debb70df5ed5e8d44ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_649f222d62844debb70df5ed5e8d44ad", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:53:35.426917 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant: tempest-DeleteServersTestJSON-237477954 Aug 24 03:53:35.426917 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Id: 649f222d62844debb70df5ed5e8d44ad Aug 24 03:53:35.426917 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Name: tempest-DeleteServersTestJSON-237477954 Aug 24 03:53:35.426917 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User: tempest-DeleteServersTestJSON-237477954-project Aug 24 03:53:35.426917 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Id: default Aug 24 03:53:35.426917 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Name: Default Aug 24 03:53:35.426917 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Id: a466f40eba2a4975bd13614474ff527c Aug 24 03:53:35.426917 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Name: tempest-DeleteServersTestJSON-237477954-project Aug 24 03:53:35.426917 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: method: > Aug 24 03:53:35.426917 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: exception: Instance 0090ef1a-b99b-4032-834a-bfa5d112dfc5 could not be found. Aug 24 03:53:35.426917 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: action_args: {'id': '0090ef1a-b99b-4032-834a-bfa5d112dfc5'} Aug 24 03:53:35.427898 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:53:35.427898 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:35.427898 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:53:35.427898 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:53:35.427898 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:53:35.427898 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:53:35.427898 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:53:35.427898 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:53:35.427898 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:53:35.427898 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:53:35.427898 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0090ef1a-b99b-4032-834a-bfa5d112dfc5 could not be found. Aug 24 03:53:35.427898 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:53:35.427898 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:53:35.427898 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:53:35.427898 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:35.427898 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:53:35.427898 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:53:35.427898 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:53:35.427898 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:53:35.427898 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:53:35.429500 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:53:35.429500 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:53:35.429500 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:53:35.429500 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:53:35.429500 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:53:35.429500 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:53:35.429500 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:53:35.429500 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0090ef1a-b99b-4032-834a-bfa5d112dfc5 could not be found. Aug 24 03:53:35.429500 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:53:35.429500 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:53:35.429500 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:53:35.429500 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:35.429500 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:53:35.429500 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:53:35.429500 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:53:35.429500 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:53:35.429500 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0090ef1a-b99b-4032-834a-bfa5d112dfc5 could not be found. Aug 24 03:53:35.429500 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:53:35.430840 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-9fea9ab0-8787-47fa-9022-123fc65d5ea3 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Returning 404 to user: Instance 0090ef1a-b99b-4032-834a-bfa5d112dfc5 could not be found. {{(pid=127869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:53:35.430840 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-9fea9ab0-8787-47fa-9022-123fc65d5ea3 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] 10.222.0.82 "GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5" status: 404 len: 111 microversion: 2.1 time: 0.037060 Aug 24 03:53:35.430840 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 102/201] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:35 2022] GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:53:35.547576 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f379f42b-6308-4bf4-b600-14bee4bdc2bb tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:35.549859 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f379f42b-6308-4bf4-b600-14bee4bdc2bb tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] [instance: 0090ef1a-b99b-4032-834a-bfa5d112dfc5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:35.556507 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f379f42b-6308-4bf4-b600-14bee4bdc2bb tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:35.556985 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f379f42b-6308-4bf4-b600-14bee4bdc2bb tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:35.557428 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f379f42b-6308-4bf4-b600-14bee4bdc2bb tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:35.558372 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f379f42b-6308-4bf4-b600-14bee4bdc2bb tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:35.558905 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f379f42b-6308-4bf4-b600-14bee4bdc2bb tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:35.559336 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f379f42b-6308-4bf4-b600-14bee4bdc2bb tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:35.576393 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-f379f42b-6308-4bf4-b600-14bee4bdc2bb tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] HTTP exception thrown: Instance 0090ef1a-b99b-4032-834a-bfa5d112dfc5 could not be found. Aug 24 03:53:35.580455 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f379f42b-6308-4bf4-b600-14bee4bdc2bb tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Request method failure captured: Aug 24 03:53:35.580455 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5/os-volume_attachments HTTP/1.1 Aug 24 03:53:35.580455 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept: application/json Aug 24 03:53:35.580455 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept-Encoding: identity Aug 24 03:53:35.580455 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Connection: close Aug 24 03:53:35.580455 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Length: 0 Aug 24 03:53:35.580455 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Type: application/json Aug 24 03:53:35.580455 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Host: 10.222.0.82 Aug 24 03:53:35.580455 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Openstack-System-Scope: None Aug 24 03:53:35.580455 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.11 Aug 24 03:53:35.580455 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Auth-Token: gAAAAABjBaBwwlgmGgCr0_yEKzKCnCCgG2tc8QZlQfMBbrrwL7_NLU9LU1aI51fUit1JPjRvy_WDCwd0cfpOOhG0l1tFz5TNMyfHFLUAxkZBIEwi6Zh9sZ1ugLBAyCZz2eVkDpiSCFL-p6lWCcqTgAQxFsYehmh42ws_m3sxYVdwqvKqA06rpS8 Aug 24 03:53:35.580455 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Id: None Aug 24 03:53:35.580455 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Name: None Aug 24 03:53:35.580455 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Identity-Status: Confirmed Aug 24 03:53:35.580455 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Is-Admin-Project: True Aug 24 03:53:35.580455 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Id: default Aug 24 03:53:35.580455 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Name: Default Aug 24 03:53:35.580455 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Id: 649f222d62844debb70df5ed5e8d44ad Aug 24 03:53:35.580455 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Name: tempest-DeleteServersTestJSON-237477954 Aug 24 03:53:35.580455 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Role: member,reader Aug 24 03:53:35.580455 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Roles: member,reader Aug 24 03:53:35.581886 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/649f222d62844debb70df5ed5e8d44ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/649f222d62844debb70df5ed5e8d44ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/649f222d62844debb70df5ed5e8d44ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_649f222d62844debb70df5ed5e8d44ad", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:53:35.581886 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant: tempest-DeleteServersTestJSON-237477954 Aug 24 03:53:35.581886 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Id: 649f222d62844debb70df5ed5e8d44ad Aug 24 03:53:35.581886 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Name: tempest-DeleteServersTestJSON-237477954 Aug 24 03:53:35.581886 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User: tempest-DeleteServersTestJSON-237477954-project Aug 24 03:53:35.581886 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Id: default Aug 24 03:53:35.581886 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Name: Default Aug 24 03:53:35.581886 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Id: a466f40eba2a4975bd13614474ff527c Aug 24 03:53:35.581886 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Name: tempest-DeleteServersTestJSON-237477954-project Aug 24 03:53:35.581886 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: method: > Aug 24 03:53:35.581886 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: exception: Instance 0090ef1a-b99b-4032-834a-bfa5d112dfc5 could not be found. Aug 24 03:53:35.581886 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: action_args: {'server_id': '0090ef1a-b99b-4032-834a-bfa5d112dfc5'} Aug 24 03:53:35.582729 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:53:35.582729 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:35.582729 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:53:35.582729 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:53:35.582729 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:53:35.582729 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:53:35.582729 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:53:35.582729 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:53:35.582729 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:53:35.582729 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:53:35.582729 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0090ef1a-b99b-4032-834a-bfa5d112dfc5 could not be found. Aug 24 03:53:35.582729 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:53:35.582729 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:53:35.582729 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:53:35.582729 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:35.582729 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:53:35.582729 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:53:35.582729 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:53:35.582729 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:53:35.582729 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:53:35.584022 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:53:35.584022 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 03:53:35.584022 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:53:35.584022 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 03:53:35.584022 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:53:35.584022 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 03:53:35.584022 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 03:53:35.584022 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:53:35.584022 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:53:35.584022 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0090ef1a-b99b-4032-834a-bfa5d112dfc5 could not be found. Aug 24 03:53:35.584022 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:53:35.584022 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:53:35.584022 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:53:35.584022 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:35.584022 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:53:35.584022 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:53:35.584022 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:53:35.584022 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:53:35.584022 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0090ef1a-b99b-4032-834a-bfa5d112dfc5 could not be found. Aug 24 03:53:35.584022 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:53:35.586120 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f379f42b-6308-4bf4-b600-14bee4bdc2bb tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Returning 404 to user: Instance 0090ef1a-b99b-4032-834a-bfa5d112dfc5 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:53:35.586120 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f379f42b-6308-4bf4-b600-14bee4bdc2bb tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] 10.222.0.82 "GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.039659 Aug 24 03:53:35.586120 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 100/202] 10.222.0.82 () {58 vars in 1302 bytes} [Wed Aug 24 03:53:35 2022] GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5/os-volume_attachments => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:53:36.005780 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-cb3a6a50-c761-4c90-bffe-77dc698aa28a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:36.006412 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-cb3a6a50-c761-4c90-bffe-77dc698aa28a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:36.013461 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cb3a6a50-c761-4c90-bffe-77dc698aa28a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:36.013937 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cb3a6a50-c761-4c90-bffe-77dc698aa28a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:36.014374 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cb3a6a50-c761-4c90-bffe-77dc698aa28a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:36.015182 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cb3a6a50-c761-4c90-bffe-77dc698aa28a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:36.015837 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cb3a6a50-c761-4c90-bffe-77dc698aa28a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:36.016272 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cb3a6a50-c761-4c90-bffe-77dc698aa28a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:36.155656 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-cb3a6a50-c761-4c90-bffe-77dc698aa28a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:36.163656 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-cb3a6a50-c761-4c90-bffe-77dc698aa28a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.161677 Aug 24 03:53:36.164216 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 103/203] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:36 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:37.184998 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7d66bc99-a855-43f1-8d0a-9c379fb188c7 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:37.185776 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7d66bc99-a855-43f1-8d0a-9c379fb188c7 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:37.189409 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=45 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:37.192928 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7d66bc99-a855-43f1-8d0a-9c379fb188c7 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:37.193420 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7d66bc99-a855-43f1-8d0a-9c379fb188c7 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:37.193830 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7d66bc99-a855-43f1-8d0a-9c379fb188c7 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:37.195154 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7d66bc99-a855-43f1-8d0a-9c379fb188c7 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:37.195640 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7d66bc99-a855-43f1-8d0a-9c379fb188c7 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:37.196196 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7d66bc99-a855-43f1-8d0a-9c379fb188c7 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:37.555932 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-7d66bc99-a855-43f1-8d0a-9c379fb188c7 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:37.563738 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7d66bc99-a855-43f1-8d0a-9c379fb188c7 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.382824 Aug 24 03:53:37.564502 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 101/204] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:37 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:38.037173 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-f401107e-5d79-4dc7-bb03-b8c47e2553f9 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:38.037651 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-f401107e-5d79-4dc7-bb03-b8c47e2553f9 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] [instance: 0090ef1a-b99b-4032-834a-bfa5d112dfc5] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:38.044286 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f401107e-5d79-4dc7-bb03-b8c47e2553f9 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:38.044765 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f401107e-5d79-4dc7-bb03-b8c47e2553f9 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:38.045199 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f401107e-5d79-4dc7-bb03-b8c47e2553f9 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:38.045882 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f401107e-5d79-4dc7-bb03-b8c47e2553f9 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:38.046364 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f401107e-5d79-4dc7-bb03-b8c47e2553f9 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:38.046832 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f401107e-5d79-4dc7-bb03-b8c47e2553f9 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:38.061103 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.wsgi [None req-f401107e-5d79-4dc7-bb03-b8c47e2553f9 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] HTTP exception thrown: Instance 0090ef1a-b99b-4032-834a-bfa5d112dfc5 could not be found. Aug 24 03:53:38.065537 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-f401107e-5d79-4dc7-bb03-b8c47e2553f9 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Request method failure captured: Aug 24 03:53:38.065537 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: request: DELETE /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5 HTTP/1.1 Aug 24 03:53:38.065537 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept: application/json Aug 24 03:53:38.065537 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept-Encoding: identity Aug 24 03:53:38.065537 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Connection: close Aug 24 03:53:38.065537 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Length: 0 Aug 24 03:53:38.065537 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Type: application/json Aug 24 03:53:38.065537 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Host: 10.222.0.82 Aug 24 03:53:38.065537 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Openstack-System-Scope: None Aug 24 03:53:38.065537 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: User-Agent: python-urllib3/1.26.11 Aug 24 03:53:38.065537 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Auth-Token: gAAAAABjBaBwwlgmGgCr0_yEKzKCnCCgG2tc8QZlQfMBbrrwL7_NLU9LU1aI51fUit1JPjRvy_WDCwd0cfpOOhG0l1tFz5TNMyfHFLUAxkZBIEwi6Zh9sZ1ugLBAyCZz2eVkDpiSCFL-p6lWCcqTgAQxFsYehmh42ws_m3sxYVdwqvKqA06rpS8 Aug 24 03:53:38.065537 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Id: None Aug 24 03:53:38.065537 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Name: None Aug 24 03:53:38.065537 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Identity-Status: Confirmed Aug 24 03:53:38.065537 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Is-Admin-Project: True Aug 24 03:53:38.065537 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Id: default Aug 24 03:53:38.065537 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Name: Default Aug 24 03:53:38.065537 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Id: 649f222d62844debb70df5ed5e8d44ad Aug 24 03:53:38.065537 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Name: tempest-DeleteServersTestJSON-237477954 Aug 24 03:53:38.065537 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Role: member,reader Aug 24 03:53:38.065537 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Roles: member,reader Aug 24 03:53:38.067065 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/649f222d62844debb70df5ed5e8d44ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/649f222d62844debb70df5ed5e8d44ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/649f222d62844debb70df5ed5e8d44ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_649f222d62844debb70df5ed5e8d44ad", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:53:38.067065 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant: tempest-DeleteServersTestJSON-237477954 Aug 24 03:53:38.067065 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Id: 649f222d62844debb70df5ed5e8d44ad Aug 24 03:53:38.067065 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Name: tempest-DeleteServersTestJSON-237477954 Aug 24 03:53:38.067065 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User: tempest-DeleteServersTestJSON-237477954-project Aug 24 03:53:38.067065 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Id: default Aug 24 03:53:38.067065 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Name: Default Aug 24 03:53:38.067065 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Id: a466f40eba2a4975bd13614474ff527c Aug 24 03:53:38.067065 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Name: tempest-DeleteServersTestJSON-237477954-project Aug 24 03:53:38.067065 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: method: > Aug 24 03:53:38.067065 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: exception: Instance 0090ef1a-b99b-4032-834a-bfa5d112dfc5 could not be found. Aug 24 03:53:38.067065 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: action_args: {'id': '0090ef1a-b99b-4032-834a-bfa5d112dfc5'} Aug 24 03:53:38.067837 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:53:38.067837 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:38.067837 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:53:38.067837 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:53:38.067837 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:53:38.067837 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:53:38.067837 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:53:38.067837 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:53:38.067837 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:53:38.067837 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:53:38.067837 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0090ef1a-b99b-4032-834a-bfa5d112dfc5 could not be found. Aug 24 03:53:38.067837 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:53:38.067837 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:53:38.067837 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:53:38.067837 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:38.067837 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:53:38.067837 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:53:38.067837 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:53:38.067837 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:53:38.067837 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:53:38.069229 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:53:38.069229 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:53:38.069229 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:53:38.069229 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:53:38.069229 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:53:38.069229 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:53:38.069229 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:53:38.069229 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:53:38.069229 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:53:38.069229 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0090ef1a-b99b-4032-834a-bfa5d112dfc5 could not be found. Aug 24 03:53:38.069229 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:53:38.069229 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:53:38.069229 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:53:38.069229 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:38.069229 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:53:38.069229 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:53:38.069229 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:53:38.069229 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:53:38.069229 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0090ef1a-b99b-4032-834a-bfa5d112dfc5 could not be found. Aug 24 03:53:38.069229 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:53:38.070701 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-f401107e-5d79-4dc7-bb03-b8c47e2553f9 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Returning 404 to user: Instance 0090ef1a-b99b-4032-834a-bfa5d112dfc5 could not be found. {{(pid=127869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:53:38.070701 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-f401107e-5d79-4dc7-bb03-b8c47e2553f9 tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] 10.222.0.82 "DELETE /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5" status: 404 len: 111 microversion: 2.1 time: 0.030703 Aug 24 03:53:38.070701 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 104/205] 10.222.0.82 () {58 vars in 1239 bytes} [Wed Aug 24 03:53:38 2022] DELETE /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:53:38.072531 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ed0dc2a6-ec9a-4c6b-838b-ba0407d1672b tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:38.073231 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ed0dc2a6-ec9a-4c6b-838b-ba0407d1672b tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] [instance: 0090ef1a-b99b-4032-834a-bfa5d112dfc5] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:38.079222 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed0dc2a6-ec9a-4c6b-838b-ba0407d1672b tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:38.079695 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed0dc2a6-ec9a-4c6b-838b-ba0407d1672b tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:38.080123 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed0dc2a6-ec9a-4c6b-838b-ba0407d1672b tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:38.080802 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed0dc2a6-ec9a-4c6b-838b-ba0407d1672b tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:38.081256 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed0dc2a6-ec9a-4c6b-838b-ba0407d1672b tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:38.081665 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed0dc2a6-ec9a-4c6b-838b-ba0407d1672b tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:38.094818 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-ed0dc2a6-ec9a-4c6b-838b-ba0407d1672b tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] HTTP exception thrown: Instance 0090ef1a-b99b-4032-834a-bfa5d112dfc5 could not be found. Aug 24 03:53:38.096972 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ed0dc2a6-ec9a-4c6b-838b-ba0407d1672b tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Request method failure captured: Aug 24 03:53:38.096972 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5 HTTP/1.1 Aug 24 03:53:38.096972 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept: application/json Aug 24 03:53:38.096972 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept-Encoding: identity Aug 24 03:53:38.096972 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Connection: close Aug 24 03:53:38.096972 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Length: 0 Aug 24 03:53:38.096972 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Type: application/json Aug 24 03:53:38.096972 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Host: 10.222.0.82 Aug 24 03:53:38.096972 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Openstack-System-Scope: None Aug 24 03:53:38.096972 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.11 Aug 24 03:53:38.096972 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Auth-Token: gAAAAABjBaBwwlgmGgCr0_yEKzKCnCCgG2tc8QZlQfMBbrrwL7_NLU9LU1aI51fUit1JPjRvy_WDCwd0cfpOOhG0l1tFz5TNMyfHFLUAxkZBIEwi6Zh9sZ1ugLBAyCZz2eVkDpiSCFL-p6lWCcqTgAQxFsYehmh42ws_m3sxYVdwqvKqA06rpS8 Aug 24 03:53:38.096972 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Id: None Aug 24 03:53:38.096972 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Name: None Aug 24 03:53:38.096972 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Identity-Status: Confirmed Aug 24 03:53:38.096972 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Is-Admin-Project: True Aug 24 03:53:38.096972 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Id: default Aug 24 03:53:38.096972 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Name: Default Aug 24 03:53:38.096972 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Id: 649f222d62844debb70df5ed5e8d44ad Aug 24 03:53:38.096972 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Name: tempest-DeleteServersTestJSON-237477954 Aug 24 03:53:38.096972 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Role: member,reader Aug 24 03:53:38.096972 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Roles: member,reader Aug 24 03:53:38.098378 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/649f222d62844debb70df5ed5e8d44ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/649f222d62844debb70df5ed5e8d44ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/649f222d62844debb70df5ed5e8d44ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_649f222d62844debb70df5ed5e8d44ad", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:53:38.098378 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant: tempest-DeleteServersTestJSON-237477954 Aug 24 03:53:38.098378 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Id: 649f222d62844debb70df5ed5e8d44ad Aug 24 03:53:38.098378 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Name: tempest-DeleteServersTestJSON-237477954 Aug 24 03:53:38.098378 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User: tempest-DeleteServersTestJSON-237477954-project Aug 24 03:53:38.098378 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Id: default Aug 24 03:53:38.098378 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Name: Default Aug 24 03:53:38.098378 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Id: a466f40eba2a4975bd13614474ff527c Aug 24 03:53:38.098378 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Name: tempest-DeleteServersTestJSON-237477954-project Aug 24 03:53:38.098378 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: method: > Aug 24 03:53:38.098378 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: exception: Instance 0090ef1a-b99b-4032-834a-bfa5d112dfc5 could not be found. Aug 24 03:53:38.098378 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: action_args: {'id': '0090ef1a-b99b-4032-834a-bfa5d112dfc5'} Aug 24 03:53:38.099214 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:53:38.099214 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:38.099214 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:53:38.099214 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:53:38.099214 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:53:38.099214 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:53:38.099214 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:53:38.099214 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:53:38.099214 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:53:38.099214 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:53:38.099214 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0090ef1a-b99b-4032-834a-bfa5d112dfc5 could not be found. Aug 24 03:53:38.099214 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:53:38.099214 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:53:38.099214 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:53:38.099214 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:38.099214 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:53:38.099214 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:53:38.099214 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:53:38.099214 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:53:38.099214 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:53:38.101020 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:53:38.101020 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:53:38.101020 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:53:38.101020 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:53:38.101020 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:53:38.101020 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:53:38.101020 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:53:38.101020 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0090ef1a-b99b-4032-834a-bfa5d112dfc5 could not be found. Aug 24 03:53:38.101020 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:53:38.101020 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:53:38.101020 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:53:38.101020 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:38.101020 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:53:38.101020 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:53:38.101020 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:53:38.101020 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:53:38.101020 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0090ef1a-b99b-4032-834a-bfa5d112dfc5 could not be found. Aug 24 03:53:38.101020 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:53:38.102331 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ed0dc2a6-ec9a-4c6b-838b-ba0407d1672b tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] Returning 404 to user: Instance 0090ef1a-b99b-4032-834a-bfa5d112dfc5 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:53:38.102331 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ed0dc2a6-ec9a-4c6b-838b-ba0407d1672b tempest-DeleteServersTestJSON-237477954 tempest-DeleteServersTestJSON-237477954-project] 10.222.0.82 "GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5" status: 404 len: 111 microversion: 2.1 time: 0.029644 Aug 24 03:53:38.102331 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 102/206] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:38 2022] GET /compute/v2.1/servers/0090ef1a-b99b-4032-834a-bfa5d112dfc5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:53:38.584457 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-82cf1b18-9d12-4a9d-a4f6-59df3bdf8373 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:38.585878 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-82cf1b18-9d12-4a9d-a4f6-59df3bdf8373 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:38.591787 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-82cf1b18-9d12-4a9d-a4f6-59df3bdf8373 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:38.592473 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-82cf1b18-9d12-4a9d-a4f6-59df3bdf8373 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:38.592901 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-82cf1b18-9d12-4a9d-a4f6-59df3bdf8373 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:38.593578 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-82cf1b18-9d12-4a9d-a4f6-59df3bdf8373 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:38.594024 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-82cf1b18-9d12-4a9d-a4f6-59df3bdf8373 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:38.594435 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-82cf1b18-9d12-4a9d-a4f6-59df3bdf8373 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:38.838779 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-82cf1b18-9d12-4a9d-a4f6-59df3bdf8373 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:38.847829 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-82cf1b18-9d12-4a9d-a4f6-59df3bdf8373 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.267273 Aug 24 03:53:38.848399 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 105/207] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:38 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:39.869499 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1c705795-4c46-4e80-b089-ae34b38649e4 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:39.870129 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1c705795-4c46-4e80-b089-ae34b38649e4 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:39.877276 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1c705795-4c46-4e80-b089-ae34b38649e4 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:39.877761 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1c705795-4c46-4e80-b089-ae34b38649e4 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:39.878192 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1c705795-4c46-4e80-b089-ae34b38649e4 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:39.878894 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1c705795-4c46-4e80-b089-ae34b38649e4 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:39.879756 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1c705795-4c46-4e80-b089-ae34b38649e4 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:39.880182 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1c705795-4c46-4e80-b089-ae34b38649e4 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:40.042404 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-1c705795-4c46-4e80-b089-ae34b38649e4 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:40.050475 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1c705795-4c46-4e80-b089-ae34b38649e4 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.185055 Aug 24 03:53:40.051688 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 103/208] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:39 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:41.072373 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-0dd58bfb-6633-4641-b3c6-47f802216fa6 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:41.073019 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-0dd58bfb-6633-4641-b3c6-47f802216fa6 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:41.079728 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0dd58bfb-6633-4641-b3c6-47f802216fa6 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:41.080212 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0dd58bfb-6633-4641-b3c6-47f802216fa6 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:41.080645 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0dd58bfb-6633-4641-b3c6-47f802216fa6 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:41.081340 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0dd58bfb-6633-4641-b3c6-47f802216fa6 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:41.081785 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0dd58bfb-6633-4641-b3c6-47f802216fa6 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:41.082382 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0dd58bfb-6633-4641-b3c6-47f802216fa6 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:41.217066 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-0dd58bfb-6633-4641-b3c6-47f802216fa6 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:41.224897 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-0dd58bfb-6633-4641-b3c6-47f802216fa6 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.157218 Aug 24 03:53:41.225454 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 106/209] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:41 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:42.245639 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1e98c20e-f474-4708-a964-68af81801361 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:42.246246 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1e98c20e-f474-4708-a964-68af81801361 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:42.253092 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1e98c20e-f474-4708-a964-68af81801361 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:42.253562 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1e98c20e-f474-4708-a964-68af81801361 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:42.253989 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1e98c20e-f474-4708-a964-68af81801361 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:42.254694 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1e98c20e-f474-4708-a964-68af81801361 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:42.255181 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1e98c20e-f474-4708-a964-68af81801361 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:42.260964 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1e98c20e-f474-4708-a964-68af81801361 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:42.395359 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-1e98c20e-f474-4708-a964-68af81801361 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:42.405264 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1e98c20e-f474-4708-a964-68af81801361 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.163533 Aug 24 03:53:42.405944 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 104/210] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:42 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:43.427428 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-c3c14947-f7c3-499b-975c-f6224ce70d42 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:43.428085 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-c3c14947-f7c3-499b-975c-f6224ce70d42 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:43.434378 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c3c14947-f7c3-499b-975c-f6224ce70d42 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:43.434887 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c3c14947-f7c3-499b-975c-f6224ce70d42 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:43.435491 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c3c14947-f7c3-499b-975c-f6224ce70d42 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:43.436180 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c3c14947-f7c3-499b-975c-f6224ce70d42 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:43.436626 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c3c14947-f7c3-499b-975c-f6224ce70d42 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:43.437043 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c3c14947-f7c3-499b-975c-f6224ce70d42 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:43.573601 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-c3c14947-f7c3-499b-975c-f6224ce70d42 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:43.581442 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-c3c14947-f7c3-499b-975c-f6224ce70d42 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.157936 Aug 24 03:53:43.582005 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 107/211] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:43 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:44.603962 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f7316c68-9c46-4b5f-840c-5c1e20ecaa07 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:44.604577 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f7316c68-9c46-4b5f-840c-5c1e20ecaa07 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:44.621804 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f7316c68-9c46-4b5f-840c-5c1e20ecaa07 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:44.621804 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f7316c68-9c46-4b5f-840c-5c1e20ecaa07 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:44.621804 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f7316c68-9c46-4b5f-840c-5c1e20ecaa07 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:44.621804 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f7316c68-9c46-4b5f-840c-5c1e20ecaa07 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:44.622144 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f7316c68-9c46-4b5f-840c-5c1e20ecaa07 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:44.622144 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f7316c68-9c46-4b5f-840c-5c1e20ecaa07 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:44.753811 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-f7316c68-9c46-4b5f-840c-5c1e20ecaa07 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:44.762408 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f7316c68-9c46-4b5f-840c-5c1e20ecaa07 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.163462 Aug 24 03:53:44.763085 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 105/212] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:44 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:45.787137 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-875d73d7-06bc-4e6b-9866-f3f2c670be83 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:45.792221 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-875d73d7-06bc-4e6b-9866-f3f2c670be83 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:45.794292 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-875d73d7-06bc-4e6b-9866-f3f2c670be83 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:45.794815 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-875d73d7-06bc-4e6b-9866-f3f2c670be83 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:45.795383 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-875d73d7-06bc-4e6b-9866-f3f2c670be83 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:45.796236 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-875d73d7-06bc-4e6b-9866-f3f2c670be83 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:45.796682 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-875d73d7-06bc-4e6b-9866-f3f2c670be83 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:45.797267 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-875d73d7-06bc-4e6b-9866-f3f2c670be83 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:45.939806 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-875d73d7-06bc-4e6b-9866-f3f2c670be83 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:45.949599 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-875d73d7-06bc-4e6b-9866-f3f2c670be83 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.168910 Aug 24 03:53:45.950189 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 108/213] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:45 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:46.971953 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c5f6b4a7-cdf2-4492-a3ab-2e5506a7253e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:46.972493 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c5f6b4a7-cdf2-4492-a3ab-2e5506a7253e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:46.979160 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c5f6b4a7-cdf2-4492-a3ab-2e5506a7253e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:46.979631 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c5f6b4a7-cdf2-4492-a3ab-2e5506a7253e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:46.980057 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c5f6b4a7-cdf2-4492-a3ab-2e5506a7253e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:46.980735 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c5f6b4a7-cdf2-4492-a3ab-2e5506a7253e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:46.981175 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c5f6b4a7-cdf2-4492-a3ab-2e5506a7253e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:46.981594 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c5f6b4a7-cdf2-4492-a3ab-2e5506a7253e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:47.122593 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-c5f6b4a7-cdf2-4492-a3ab-2e5506a7253e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:47.131143 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:47.131143 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c5f6b4a7-cdf2-4492-a3ab-2e5506a7253e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.162916 Aug 24 03:53:47.131376 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 106/214] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:46 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:48.152704 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-6fff4c5a-eeb1-4855-b6d1-a78e9e12f85d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:48.153313 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-6fff4c5a-eeb1-4855-b6d1-a78e9e12f85d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:48.159495 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6fff4c5a-eeb1-4855-b6d1-a78e9e12f85d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:48.159977 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6fff4c5a-eeb1-4855-b6d1-a78e9e12f85d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:48.160411 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6fff4c5a-eeb1-4855-b6d1-a78e9e12f85d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:48.161098 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6fff4c5a-eeb1-4855-b6d1-a78e9e12f85d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:48.161546 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6fff4c5a-eeb1-4855-b6d1-a78e9e12f85d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:48.161965 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6fff4c5a-eeb1-4855-b6d1-a78e9e12f85d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:48.310953 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-6fff4c5a-eeb1-4855-b6d1-a78e9e12f85d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:48.321280 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-6fff4c5a-eeb1-4855-b6d1-a78e9e12f85d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.172538 Aug 24 03:53:48.325217 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 109/215] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:48 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:48.942860 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-28ac775d-9aa6-4dc1-b306-19e8fd39c536 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2018026236", "imageRef": "c32522f7-22a8-45d4-a51e-f17637def2e1", "flavorRef": "452"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:48.999154 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-28ac775d-9aa6-4dc1-b306-19e8fd39c536 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] validate_networks() for None {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:53:49.316143 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-28ac775d-9aa6-4dc1-b306-19e8fd39c536 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:53:49.316501 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-28ac775d-9aa6-4dc1-b306-19e8fd39c536 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:53:49.316987 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-28ac775d-9aa6-4dc1-b306-19e8fd39c536 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:53:49.317392 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-28ac775d-9aa6-4dc1-b306-19e8fd39c536 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:53:49.317819 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-28ac775d-9aa6-4dc1-b306-19e8fd39c536 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:53:49.326946 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-28ac775d-9aa6-4dc1-b306-19e8fd39c536 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:49.327420 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-28ac775d-9aa6-4dc1-b306-19e8fd39c536 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:49.327845 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-28ac775d-9aa6-4dc1-b306-19e8fd39c536 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:49.328554 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-28ac775d-9aa6-4dc1-b306-19e8fd39c536 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:49.328996 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-28ac775d-9aa6-4dc1-b306-19e8fd39c536 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:49.329407 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-28ac775d-9aa6-4dc1-b306-19e8fd39c536 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:49.346495 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.quota [None req-28ac775d-9aa6-4dc1-b306-19e8fd39c536 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Getting quotas for project 82af5eacc6004249910b0e3cbd8b7f34. Resources: {'instances', 'cores', 'ram'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:53:49.349087 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-e6fd3c79-0c9a-4bd4-9dc3-f389a6b6c224 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:49.349830 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-e6fd3c79-0c9a-4bd4-9dc3-f389a6b6c224 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:49.352102 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.quota [None req-28ac775d-9aa6-4dc1-b306-19e8fd39c536 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Getting quotas for user a561c97996cc4677823df848773232e6 and project 82af5eacc6004249910b0e3cbd8b7f34. Resources: {'instances', 'cores', 'ram'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:53:49.357308 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e6fd3c79-0c9a-4bd4-9dc3-f389a6b6c224 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:49.358231 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e6fd3c79-0c9a-4bd4-9dc3-f389a6b6c224 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:49.359024 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e6fd3c79-0c9a-4bd4-9dc3-f389a6b6c224 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:49.359761 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e6fd3c79-0c9a-4bd4-9dc3-f389a6b6c224 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:49.360377 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e6fd3c79-0c9a-4bd4-9dc3-f389a6b6c224 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:49.360832 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e6fd3c79-0c9a-4bd4-9dc3-f389a6b6c224 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:49.364256 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-28ac775d-9aa6-4dc1-b306-19e8fd39c536 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:53:49.367186 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-28ac775d-9aa6-4dc1-b306-19e8fd39c536 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] [instance: bbb72400-6c37-4ad3-a470-2925707d0e4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c32522f7-22a8-45d4-a51e-f17637def2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:53:49.498263 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-e6fd3c79-0c9a-4bd4-9dc3-f389a6b6c224 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:49.515792 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-e6fd3c79-0c9a-4bd4-9dc3-f389a6b6c224 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.171682 Aug 24 03:53:49.516614 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 110/216] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:49 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:49.560714 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-28ac775d-9aa6-4dc1-b306-19e8fd39c536 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.622689 Aug 24 03:53:49.561355 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 107/217] 10.222.0.82 () {60 vars in 1147 bytes} [Wed Aug 24 03:53:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:53:49.572530 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-a714cdd0-11bc-4ed9-a0b0-ed4b6e9f07dd tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:49.573364 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-a714cdd0-11bc-4ed9-a0b0-ed4b6e9f07dd tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] [instance: bbb72400-6c37-4ad3-a470-2925707d0e4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:49.632677 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-a714cdd0-11bc-4ed9-a0b0-ed4b6e9f07dd tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561c97996cc4677823df848773232e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82af5eacc6004249910b0e3cbd8b7f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:49.641317 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-a714cdd0-11bc-4ed9-a0b0-ed4b6e9f07dd tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] 10.222.0.82 "GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b" status: 200 len: 1215 microversion: 2.1 time: 0.072259 Aug 24 03:53:49.642637 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 111/218] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:49 2022] GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b => generated 1215 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:50.537967 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-65845b3b-50ba-4859-9d86-a7317ccf40ef tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:50.538586 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-65845b3b-50ba-4859-9d86-a7317ccf40ef tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:50.545006 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-65845b3b-50ba-4859-9d86-a7317ccf40ef tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:50.545483 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-65845b3b-50ba-4859-9d86-a7317ccf40ef tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:50.545915 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-65845b3b-50ba-4859-9d86-a7317ccf40ef tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:50.546632 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-65845b3b-50ba-4859-9d86-a7317ccf40ef tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:50.547086 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-65845b3b-50ba-4859-9d86-a7317ccf40ef tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:50.547507 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-65845b3b-50ba-4859-9d86-a7317ccf40ef tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:50.664894 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-e6b69a82-213d-41e8-89aa-ccad234cbfbe tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:50.665611 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-e6b69a82-213d-41e8-89aa-ccad234cbfbe tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] [instance: bbb72400-6c37-4ad3-a470-2925707d0e4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:50.672004 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e6b69a82-213d-41e8-89aa-ccad234cbfbe tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:50.672485 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e6b69a82-213d-41e8-89aa-ccad234cbfbe tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:50.673086 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e6b69a82-213d-41e8-89aa-ccad234cbfbe tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:50.673928 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e6b69a82-213d-41e8-89aa-ccad234cbfbe tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:50.674540 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e6b69a82-213d-41e8-89aa-ccad234cbfbe tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:50.675175 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e6b69a82-213d-41e8-89aa-ccad234cbfbe tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:50.687182 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-65845b3b-50ba-4859-9d86-a7317ccf40ef tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:50.695832 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-65845b3b-50ba-4859-9d86-a7317ccf40ef tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.162341 Aug 24 03:53:50.696612 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 108/219] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:50 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:50.744623 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-e6b69a82-213d-41e8-89aa-ccad234cbfbe tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561c97996cc4677823df848773232e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82af5eacc6004249910b0e3cbd8b7f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:50.752795 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-e6b69a82-213d-41e8-89aa-ccad234cbfbe tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] 10.222.0.82 "GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b" status: 200 len: 1219 microversion: 2.1 time: 0.092533 Aug 24 03:53:50.753362 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 112/220] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:50 2022] GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:51.717219 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5c1d1c3b-1ac0-411f-a133-b6d1117cb750 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:51.717972 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5c1d1c3b-1ac0-411f-a133-b6d1117cb750 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:51.727507 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5c1d1c3b-1ac0-411f-a133-b6d1117cb750 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:51.728348 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5c1d1c3b-1ac0-411f-a133-b6d1117cb750 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:51.729094 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5c1d1c3b-1ac0-411f-a133-b6d1117cb750 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:51.730298 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5c1d1c3b-1ac0-411f-a133-b6d1117cb750 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:51.731156 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5c1d1c3b-1ac0-411f-a133-b6d1117cb750 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:51.731914 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5c1d1c3b-1ac0-411f-a133-b6d1117cb750 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:51.774006 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-ed2a577f-febe-40ac-bb15-2d37357251a2 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:51.774650 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-ed2a577f-febe-40ac-bb15-2d37357251a2 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] [instance: bbb72400-6c37-4ad3-a470-2925707d0e4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:51.781523 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ed2a577f-febe-40ac-bb15-2d37357251a2 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:51.782012 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ed2a577f-febe-40ac-bb15-2d37357251a2 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:51.782439 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ed2a577f-febe-40ac-bb15-2d37357251a2 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:51.783183 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ed2a577f-febe-40ac-bb15-2d37357251a2 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:51.783631 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ed2a577f-febe-40ac-bb15-2d37357251a2 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:51.784124 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ed2a577f-febe-40ac-bb15-2d37357251a2 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:51.848554 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-ed2a577f-febe-40ac-bb15-2d37357251a2 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561c97996cc4677823df848773232e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82af5eacc6004249910b0e3cbd8b7f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:51.856353 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-ed2a577f-febe-40ac-bb15-2d37357251a2 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] 10.222.0.82 "GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b" status: 200 len: 1219 microversion: 2.1 time: 0.086925 Aug 24 03:53:51.856922 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 113/221] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:51 2022] GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:51.872050 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-5c1d1c3b-1ac0-411f-a133-b6d1117cb750 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:51.879787 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5c1d1c3b-1ac0-411f-a133-b6d1117cb750 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.166886 Aug 24 03:53:51.880347 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 109/222] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:51 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:52.877970 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-9a44d856-c27a-4f5c-b6a0-2c6c4d72e63e tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:52.878522 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-9a44d856-c27a-4f5c-b6a0-2c6c4d72e63e tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] [instance: bbb72400-6c37-4ad3-a470-2925707d0e4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:52.885361 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9a44d856-c27a-4f5c-b6a0-2c6c4d72e63e tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:52.885839 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9a44d856-c27a-4f5c-b6a0-2c6c4d72e63e tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:52.886269 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9a44d856-c27a-4f5c-b6a0-2c6c4d72e63e tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:52.887261 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9a44d856-c27a-4f5c-b6a0-2c6c4d72e63e tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:52.887711 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9a44d856-c27a-4f5c-b6a0-2c6c4d72e63e tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:52.888296 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9a44d856-c27a-4f5c-b6a0-2c6c4d72e63e tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:52.902078 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ed45cdf5-e12a-4d44-9cde-91f9dfdc4c0d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:52.902728 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ed45cdf5-e12a-4d44-9cde-91f9dfdc4c0d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:52.909081 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed45cdf5-e12a-4d44-9cde-91f9dfdc4c0d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:52.909562 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed45cdf5-e12a-4d44-9cde-91f9dfdc4c0d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:52.910007 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed45cdf5-e12a-4d44-9cde-91f9dfdc4c0d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:52.910752 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed45cdf5-e12a-4d44-9cde-91f9dfdc4c0d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:52.911212 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed45cdf5-e12a-4d44-9cde-91f9dfdc4c0d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:52.911634 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed45cdf5-e12a-4d44-9cde-91f9dfdc4c0d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:52.952369 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-9a44d856-c27a-4f5c-b6a0-2c6c4d72e63e tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561c97996cc4677823df848773232e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82af5eacc6004249910b0e3cbd8b7f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:52.961165 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-9a44d856-c27a-4f5c-b6a0-2c6c4d72e63e tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] 10.222.0.82 "GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b" status: 200 len: 1219 microversion: 2.1 time: 0.087071 Aug 24 03:53:52.962155 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 114/223] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:52 2022] GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:53.048353 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-ed45cdf5-e12a-4d44-9cde-91f9dfdc4c0d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:53.056233 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ed45cdf5-e12a-4d44-9cde-91f9dfdc4c0d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.158563 Aug 24 03:53:53.056799 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 110/224] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:52 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:53.982947 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-c659dd6e-ec92-4d26-86b6-c74d34df9c52 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:53.983553 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-c659dd6e-ec92-4d26-86b6-c74d34df9c52 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] [instance: bbb72400-6c37-4ad3-a470-2925707d0e4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:53.989974 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c659dd6e-ec92-4d26-86b6-c74d34df9c52 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:53.991084 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c659dd6e-ec92-4d26-86b6-c74d34df9c52 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:53.991084 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c659dd6e-ec92-4d26-86b6-c74d34df9c52 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:53.991639 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c659dd6e-ec92-4d26-86b6-c74d34df9c52 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:53.992091 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c659dd6e-ec92-4d26-86b6-c74d34df9c52 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:53.992510 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c659dd6e-ec92-4d26-86b6-c74d34df9c52 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:54.081242 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-830b3a31-60da-4b47-ba4c-67fcbc3cbe0a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:54.082463 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-830b3a31-60da-4b47-ba4c-67fcbc3cbe0a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:54.093390 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-830b3a31-60da-4b47-ba4c-67fcbc3cbe0a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:54.094625 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-830b3a31-60da-4b47-ba4c-67fcbc3cbe0a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:54.095130 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-830b3a31-60da-4b47-ba4c-67fcbc3cbe0a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:54.096046 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-830b3a31-60da-4b47-ba4c-67fcbc3cbe0a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:54.096580 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-830b3a31-60da-4b47-ba4c-67fcbc3cbe0a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:54.097091 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-830b3a31-60da-4b47-ba4c-67fcbc3cbe0a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:54.207675 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-c659dd6e-ec92-4d26-86b6-c74d34df9c52 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561c97996cc4677823df848773232e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82af5eacc6004249910b0e3cbd8b7f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:54.217245 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-c659dd6e-ec92-4d26-86b6-c74d34df9c52 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] 10.222.0.82 "GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b" status: 200 len: 1211 microversion: 2.1 time: 0.238132 Aug 24 03:53:54.217671 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 115/225] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:53 2022] GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b => generated 1211 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:54.242254 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-830b3a31-60da-4b47-ba4c-67fcbc3cbe0a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:54.250700 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-830b3a31-60da-4b47-ba4c-67fcbc3cbe0a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.174461 Aug 24 03:53:54.251282 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 111/226] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:54 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:55.237854 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-bfae9aeb-8d6c-414d-972e-bfbf129f2c56 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:55.239497 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-bfae9aeb-8d6c-414d-972e-bfbf129f2c56 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] [instance: bbb72400-6c37-4ad3-a470-2925707d0e4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:55.245962 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bfae9aeb-8d6c-414d-972e-bfbf129f2c56 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:55.246441 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bfae9aeb-8d6c-414d-972e-bfbf129f2c56 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:55.247042 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bfae9aeb-8d6c-414d-972e-bfbf129f2c56 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:55.247725 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bfae9aeb-8d6c-414d-972e-bfbf129f2c56 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:55.248193 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bfae9aeb-8d6c-414d-972e-bfbf129f2c56 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:55.248785 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bfae9aeb-8d6c-414d-972e-bfbf129f2c56 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:55.273456 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f0d8b1b9-3088-46eb-bc69-7908a079c078 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:55.274699 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f0d8b1b9-3088-46eb-bc69-7908a079c078 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:55.282335 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f0d8b1b9-3088-46eb-bc69-7908a079c078 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:55.282850 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f0d8b1b9-3088-46eb-bc69-7908a079c078 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:55.283317 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f0d8b1b9-3088-46eb-bc69-7908a079c078 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:55.284017 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f0d8b1b9-3088-46eb-bc69-7908a079c078 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:55.284502 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f0d8b1b9-3088-46eb-bc69-7908a079c078 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:55.284996 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f0d8b1b9-3088-46eb-bc69-7908a079c078 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:55.323843 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-bfae9aeb-8d6c-414d-972e-bfbf129f2c56 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561c97996cc4677823df848773232e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82af5eacc6004249910b0e3cbd8b7f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:55.331726 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-bfae9aeb-8d6c-414d-972e-bfbf129f2c56 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] 10.222.0.82 "GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b" status: 200 len: 1267 microversion: 2.1 time: 0.098103 Aug 24 03:53:55.332613 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 116/227] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:55 2022] GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b => generated 1267 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:55.422864 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-f0d8b1b9-3088-46eb-bc69-7908a079c078 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:55.431015 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f0d8b1b9-3088-46eb-bc69-7908a079c078 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.161073 Aug 24 03:53:55.431588 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 112/228] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:55 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:56.355819 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-b849c6c0-97f6-4941-b3eb-5c81ac7ba594 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:56.355819 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-b849c6c0-97f6-4941-b3eb-5c81ac7ba594 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] [instance: bbb72400-6c37-4ad3-a470-2925707d0e4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:56.362953 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b849c6c0-97f6-4941-b3eb-5c81ac7ba594 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:56.366939 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b849c6c0-97f6-4941-b3eb-5c81ac7ba594 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:56.366939 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b849c6c0-97f6-4941-b3eb-5c81ac7ba594 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:56.366939 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b849c6c0-97f6-4941-b3eb-5c81ac7ba594 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:56.366939 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b849c6c0-97f6-4941-b3eb-5c81ac7ba594 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:56.367355 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b849c6c0-97f6-4941-b3eb-5c81ac7ba594 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:56.436968 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-b849c6c0-97f6-4941-b3eb-5c81ac7ba594 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561c97996cc4677823df848773232e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82af5eacc6004249910b0e3cbd8b7f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:56.445378 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-b849c6c0-97f6-4941-b3eb-5c81ac7ba594 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] 10.222.0.82 "GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b" status: 200 len: 1267 microversion: 2.1 time: 0.095503 Aug 24 03:53:56.448704 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 117/229] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:56 2022] GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b => generated 1267 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:56.454429 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8723cefb-b395-4a08-80e2-9c4f2b3302e1 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:56.455094 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8723cefb-b395-4a08-80e2-9c4f2b3302e1 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:56.461423 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8723cefb-b395-4a08-80e2-9c4f2b3302e1 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:56.462455 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8723cefb-b395-4a08-80e2-9c4f2b3302e1 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:56.462962 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8723cefb-b395-4a08-80e2-9c4f2b3302e1 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:56.463637 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8723cefb-b395-4a08-80e2-9c4f2b3302e1 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:56.464091 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8723cefb-b395-4a08-80e2-9c4f2b3302e1 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:56.464838 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8723cefb-b395-4a08-80e2-9c4f2b3302e1 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:56.627627 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-8723cefb-b395-4a08-80e2-9c4f2b3302e1 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:56.637083 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8723cefb-b395-4a08-80e2-9c4f2b3302e1 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.187597 Aug 24 03:53:56.637908 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 113/230] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:56 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:57.474328 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-43e26d9d-2453-44a7-af3a-eeba0ade7eda tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:57.474940 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-43e26d9d-2453-44a7-af3a-eeba0ade7eda tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] [instance: bbb72400-6c37-4ad3-a470-2925707d0e4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:57.481683 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-43e26d9d-2453-44a7-af3a-eeba0ade7eda tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:57.482112 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-43e26d9d-2453-44a7-af3a-eeba0ade7eda tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:57.482571 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-43e26d9d-2453-44a7-af3a-eeba0ade7eda tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:57.483263 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-43e26d9d-2453-44a7-af3a-eeba0ade7eda tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:57.483705 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-43e26d9d-2453-44a7-af3a-eeba0ade7eda tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:57.484113 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-43e26d9d-2453-44a7-af3a-eeba0ade7eda tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:57.549486 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-43e26d9d-2453-44a7-af3a-eeba0ade7eda tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561c97996cc4677823df848773232e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82af5eacc6004249910b0e3cbd8b7f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:57.561098 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-43e26d9d-2453-44a7-af3a-eeba0ade7eda tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] 10.222.0.82 "GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b" status: 200 len: 1267 microversion: 2.1 time: 0.090519 Aug 24 03:53:57.561964 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 118/231] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:57 2022] GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b => generated 1267 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:57.661635 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b58a4575-25c9-4d68-8b1d-ec7ea43aae2a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:57.662376 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b58a4575-25c9-4d68-8b1d-ec7ea43aae2a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:57.671311 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b58a4575-25c9-4d68-8b1d-ec7ea43aae2a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:57.671804 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b58a4575-25c9-4d68-8b1d-ec7ea43aae2a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:57.672249 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b58a4575-25c9-4d68-8b1d-ec7ea43aae2a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:57.672951 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b58a4575-25c9-4d68-8b1d-ec7ea43aae2a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:57.673405 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b58a4575-25c9-4d68-8b1d-ec7ea43aae2a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:57.673832 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b58a4575-25c9-4d68-8b1d-ec7ea43aae2a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:57.834244 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-b58a4575-25c9-4d68-8b1d-ec7ea43aae2a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:57.843744 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b58a4575-25c9-4d68-8b1d-ec7ea43aae2a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.185828 Aug 24 03:53:57.844328 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 114/232] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:57 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:58.581217 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-119718c3-e8b5-46db-8a89-dbecdb628284 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:58.581876 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-119718c3-e8b5-46db-8a89-dbecdb628284 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] [instance: bbb72400-6c37-4ad3-a470-2925707d0e4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:58.588454 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-119718c3-e8b5-46db-8a89-dbecdb628284 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:58.588941 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-119718c3-e8b5-46db-8a89-dbecdb628284 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:58.589381 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-119718c3-e8b5-46db-8a89-dbecdb628284 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:58.595898 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-119718c3-e8b5-46db-8a89-dbecdb628284 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:58.595898 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-119718c3-e8b5-46db-8a89-dbecdb628284 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:58.595898 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-119718c3-e8b5-46db-8a89-dbecdb628284 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:58.595898 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell1:SELECT=100 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:58.654862 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-119718c3-e8b5-46db-8a89-dbecdb628284 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561c97996cc4677823df848773232e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82af5eacc6004249910b0e3cbd8b7f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:58.662474 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-119718c3-e8b5-46db-8a89-dbecdb628284 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] 10.222.0.82 "GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b" status: 200 len: 1275 microversion: 2.1 time: 0.085215 Aug 24 03:53:58.663081 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 119/233] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:58 2022] GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b => generated 1275 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:58.865367 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-778a3f20-e923-4214-8bad-c971b7bae4df tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:58.865962 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-778a3f20-e923-4214-8bad-c971b7bae4df tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:58.872517 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-778a3f20-e923-4214-8bad-c971b7bae4df tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:58.873007 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-778a3f20-e923-4214-8bad-c971b7bae4df tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:58.873436 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-778a3f20-e923-4214-8bad-c971b7bae4df tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:58.874117 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-778a3f20-e923-4214-8bad-c971b7bae4df tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:58.874588 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-778a3f20-e923-4214-8bad-c971b7bae4df tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:58.875006 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-778a3f20-e923-4214-8bad-c971b7bae4df tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:59.016205 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-778a3f20-e923-4214-8bad-c971b7bae4df tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:59.024736 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-778a3f20-e923-4214-8bad-c971b7bae4df tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1522 microversion: 2.1 time: 0.163289 Aug 24 03:53:59.025315 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 115/234] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:58 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:59.701911 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-38391ba2-460d-45a6-94fa-340b80a72b07 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:59.706371 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-38391ba2-460d-45a6-94fa-340b80a72b07 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] [instance: bbb72400-6c37-4ad3-a470-2925707d0e4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:59.711185 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell0:SELECT=2 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:59.713359 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-38391ba2-460d-45a6-94fa-340b80a72b07 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:59.714204 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-38391ba2-460d-45a6-94fa-340b80a72b07 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:59.714913 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-38391ba2-460d-45a6-94fa-340b80a72b07 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:59.716034 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-38391ba2-460d-45a6-94fa-340b80a72b07 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:59.717740 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-38391ba2-460d-45a6-94fa-340b80a72b07 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:59.718555 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-38391ba2-460d-45a6-94fa-340b80a72b07 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:59.796824 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-38391ba2-460d-45a6-94fa-340b80a72b07 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561c97996cc4677823df848773232e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82af5eacc6004249910b0e3cbd8b7f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:59.804835 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-38391ba2-460d-45a6-94fa-340b80a72b07 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] 10.222.0.82 "GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b" status: 200 len: 1273 microversion: 2.1 time: 0.107666 Aug 24 03:53:59.805990 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 120/235] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:59 2022] GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b => generated 1273 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:00.046140 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-22e28491-c400-405d-89d3-ec0b6f46c84d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:00.046921 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-22e28491-c400-405d-89d3-ec0b6f46c84d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:00.048837 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:00.049552 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:00.054862 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22e28491-c400-405d-89d3-ec0b6f46c84d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:00.055371 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22e28491-c400-405d-89d3-ec0b6f46c84d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:00.055803 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22e28491-c400-405d-89d3-ec0b6f46c84d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:00.056488 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22e28491-c400-405d-89d3-ec0b6f46c84d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:00.056935 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22e28491-c400-405d-89d3-ec0b6f46c84d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:00.057350 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22e28491-c400-405d-89d3-ec0b6f46c84d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:00.289338 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-22e28491-c400-405d-89d3-ec0b6f46c84d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:00.297043 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-22e28491-c400-405d-89d3-ec0b6f46c84d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1502 microversion: 2.1 time: 0.254970 Aug 24 03:54:00.297619 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 116/236] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:00 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1502 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:00.317150 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-53e40e94-fbcb-44de-9369-be0cd7269807 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:00.317781 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-53e40e94-fbcb-44de-9369-be0cd7269807 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 13f1df4b-056e-4637-a0ec-54f6f78c8730] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:00.324490 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-53e40e94-fbcb-44de-9369-be0cd7269807 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:00.324976 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-53e40e94-fbcb-44de-9369-be0cd7269807 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:00.325410 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-53e40e94-fbcb-44de-9369-be0cd7269807 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:00.326098 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-53e40e94-fbcb-44de-9369-be0cd7269807 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:00.326582 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-53e40e94-fbcb-44de-9369-be0cd7269807 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:00.327006 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-53e40e94-fbcb-44de-9369-be0cd7269807 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:00.498801 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-53e40e94-fbcb-44de-9369-be0cd7269807 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:00.498801 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-53e40e94-fbcb-44de-9369-be0cd7269807 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730" status: 200 len: 1515 microversion: 2.1 time: 0.183865 Aug 24 03:54:00.498801 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 121/237] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:00 2022] GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730 => generated 1515 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:00.828205 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3491c040-f57e-4957-a13c-bc6033292304 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:00.828811 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3491c040-f57e-4957-a13c-bc6033292304 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] [instance: bbb72400-6c37-4ad3-a470-2925707d0e4b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:00.834969 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3491c040-f57e-4957-a13c-bc6033292304 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:00.835596 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3491c040-f57e-4957-a13c-bc6033292304 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:00.836131 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3491c040-f57e-4957-a13c-bc6033292304 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:00.836964 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3491c040-f57e-4957-a13c-bc6033292304 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:00.837489 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3491c040-f57e-4957-a13c-bc6033292304 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:00.837910 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3491c040-f57e-4957-a13c-bc6033292304 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:01.055082 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-3491c040-f57e-4957-a13c-bc6033292304 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561c97996cc4677823df848773232e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82af5eacc6004249910b0e3cbd8b7f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:01.063125 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3491c040-f57e-4957-a13c-bc6033292304 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] 10.222.0.82 "GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b" status: 200 len: 1315 microversion: 2.1 time: 0.238911 Aug 24 03:54:01.063710 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 117/238] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:00 2022] GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:01.753535 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-aba755f1-7c23-43f3-8916-02e88631de88 req-ecb96d5f-9a72-4982-af39-fc0579b4423c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbb72400-6c37-4ad3-a470-2925707d0e4b", "tag": "394d85c7-7b15-4e67-9132-667fff2085b3"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:01.764125 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-aba755f1-7c23-43f3-8916-02e88631de88 req-ecb96d5f-9a72-4982-af39-fc0579b4423c service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:01.764556 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-aba755f1-7c23-43f3-8916-02e88631de88 req-ecb96d5f-9a72-4982-af39-fc0579b4423c service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:01.764984 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-aba755f1-7c23-43f3-8916-02e88631de88 req-ecb96d5f-9a72-4982-af39-fc0579b4423c service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:01.776857 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-aba755f1-7c23-43f3-8916-02e88631de88 req-ecb96d5f-9a72-4982-af39-fc0579b4423c service nova] Creating event network-changed:394d85c7-7b15-4e67-9132-667fff2085b3 for instance bbb72400-6c37-4ad3-a470-2925707d0e4b on hv-cinder-85426 Aug 24 03:54:01.783327 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-aba755f1-7c23-43f3-8916-02e88631de88 req-ecb96d5f-9a72-4982-af39-fc0579b4423c service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032965 Aug 24 03:54:01.783926 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 122/239] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:54:02.091793 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c8785190-3f5a-4f92-90d9-671225a2e55a tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:02.093265 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c8785190-3f5a-4f92-90d9-671225a2e55a tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] [instance: bbb72400-6c37-4ad3-a470-2925707d0e4b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:02.119698 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c8785190-3f5a-4f92-90d9-671225a2e55a tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:02.120145 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c8785190-3f5a-4f92-90d9-671225a2e55a tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:02.120584 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c8785190-3f5a-4f92-90d9-671225a2e55a tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:02.122175 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c8785190-3f5a-4f92-90d9-671225a2e55a tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:02.123279 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c8785190-3f5a-4f92-90d9-671225a2e55a tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:02.123820 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c8785190-3f5a-4f92-90d9-671225a2e55a tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:02.430527 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-c8785190-3f5a-4f92-90d9-671225a2e55a tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561c97996cc4677823df848773232e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82af5eacc6004249910b0e3cbd8b7f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:02.438332 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c8785190-3f5a-4f92-90d9-671225a2e55a tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] 10.222.0.82 "GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b" status: 200 len: 1315 microversion: 2.1 time: 0.358718 Aug 24 03:54:02.439000 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 118/240] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:02 2022] GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b => generated 1315 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:03.460326 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-5dca75f5-c412-4e55-82dc-1cb835e33e9f tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:03.462759 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-5dca75f5-c412-4e55-82dc-1cb835e33e9f tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] [instance: bbb72400-6c37-4ad3-a470-2925707d0e4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:03.473310 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_api:SELECT=56 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:03.487829 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5dca75f5-c412-4e55-82dc-1cb835e33e9f tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:03.487829 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5dca75f5-c412-4e55-82dc-1cb835e33e9f tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:03.487829 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5dca75f5-c412-4e55-82dc-1cb835e33e9f tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:03.487829 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5dca75f5-c412-4e55-82dc-1cb835e33e9f tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:03.488673 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5dca75f5-c412-4e55-82dc-1cb835e33e9f tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:03.488673 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5dca75f5-c412-4e55-82dc-1cb835e33e9f tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:03.496762 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-18c66ec9-912b-4eb3-9440-f338b4a9a6a5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:03.501994 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-18c66ec9-912b-4eb3-9440-f338b4a9a6a5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 13f1df4b-056e-4637-a0ec-54f6f78c8730] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:03.520370 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-18c66ec9-912b-4eb3-9440-f338b4a9a6a5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:03.528229 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-18c66ec9-912b-4eb3-9440-f338b4a9a6a5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:03.528229 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-18c66ec9-912b-4eb3-9440-f338b4a9a6a5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:03.528229 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-18c66ec9-912b-4eb3-9440-f338b4a9a6a5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:03.528229 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-18c66ec9-912b-4eb3-9440-f338b4a9a6a5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:03.528748 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-18c66ec9-912b-4eb3-9440-f338b4a9a6a5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:03.559663 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-18c66ec9-912b-4eb3-9440-f338b4a9a6a5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lazy-loading 'flavor' on Instance uuid 13f1df4b-056e-4637-a0ec-54f6f78c8730 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:54:03.678271 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-5dca75f5-c412-4e55-82dc-1cb835e33e9f tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561c97996cc4677823df848773232e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82af5eacc6004249910b0e3cbd8b7f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:03.686588 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-5dca75f5-c412-4e55-82dc-1cb835e33e9f tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] 10.222.0.82 "GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b" status: 200 len: 1315 microversion: 2.1 time: 0.230768 Aug 24 03:54:03.689869 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 123/241] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:03 2022] GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:04.003609 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-18c66ec9-912b-4eb3-9440-f338b4a9a6a5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "POST /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730/action" status: 200 len: 32 microversion: 2.1 time: 0.511560 Aug 24 03:54:04.004912 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 119/242] 10.222.0.82 () {60 vars in 1278 bytes} [Wed Aug 24 03:54:03 2022] POST /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730/action => generated 32 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:54:04.019466 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-72389ae5-f461-42e6-bf38-30c900dc5660 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:04.020282 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-72389ae5-f461-42e6-bf38-30c900dc5660 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 13f1df4b-056e-4637-a0ec-54f6f78c8730] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:04.034095 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-72389ae5-f461-42e6-bf38-30c900dc5660 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:04.034095 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-72389ae5-f461-42e6-bf38-30c900dc5660 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:04.034095 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-72389ae5-f461-42e6-bf38-30c900dc5660 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:04.034095 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-72389ae5-f461-42e6-bf38-30c900dc5660 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:04.034712 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-72389ae5-f461-42e6-bf38-30c900dc5660 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:04.034712 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-72389ae5-f461-42e6-bf38-30c900dc5660 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:04.251431 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-72389ae5-f461-42e6-bf38-30c900dc5660 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:04.262862 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-72389ae5-f461-42e6-bf38-30c900dc5660 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730" status: 200 len: 1521 microversion: 2.1 time: 0.252357 Aug 24 03:54:04.263782 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 124/243] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:04 2022] GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:04.711010 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6008ffa3-4e16-4732-813c-8539ef3d2530 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:04.712408 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6008ffa3-4e16-4732-813c-8539ef3d2530 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] [instance: bbb72400-6c37-4ad3-a470-2925707d0e4b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:04.728462 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6008ffa3-4e16-4732-813c-8539ef3d2530 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:04.729545 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6008ffa3-4e16-4732-813c-8539ef3d2530 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:04.729545 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6008ffa3-4e16-4732-813c-8539ef3d2530 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:04.730822 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6008ffa3-4e16-4732-813c-8539ef3d2530 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:04.735113 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6008ffa3-4e16-4732-813c-8539ef3d2530 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:04.735563 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6008ffa3-4e16-4732-813c-8539ef3d2530 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:05.135146 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-6008ffa3-4e16-4732-813c-8539ef3d2530 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561c97996cc4677823df848773232e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82af5eacc6004249910b0e3cbd8b7f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:05.152622 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6008ffa3-4e16-4732-813c-8539ef3d2530 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] 10.222.0.82 "GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b" status: 200 len: 1315 microversion: 2.1 time: 0.445702 Aug 24 03:54:05.152622 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 120/244] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:04 2022] GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b => generated 1315 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:05.290894 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-f350a2f3-56ad-449b-a83f-33f1a8ee268c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:05.291507 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-f350a2f3-56ad-449b-a83f-33f1a8ee268c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 13f1df4b-056e-4637-a0ec-54f6f78c8730] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:05.297478 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f350a2f3-56ad-449b-a83f-33f1a8ee268c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:05.297953 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f350a2f3-56ad-449b-a83f-33f1a8ee268c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:05.298382 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f350a2f3-56ad-449b-a83f-33f1a8ee268c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:05.299218 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f350a2f3-56ad-449b-a83f-33f1a8ee268c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:05.299667 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f350a2f3-56ad-449b-a83f-33f1a8ee268c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:05.300084 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f350a2f3-56ad-449b-a83f-33f1a8ee268c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:05.497021 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-f350a2f3-56ad-449b-a83f-33f1a8ee268c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:05.507349 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-f350a2f3-56ad-449b-a83f-33f1a8ee268c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730" status: 200 len: 1521 microversion: 2.1 time: 0.221241 Aug 24 03:54:05.518886 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 125/245] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:05 2022] GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:06.171949 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b2fb6f06-d157-4d6a-84a8-1cacf434f215 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:06.185738 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b2fb6f06-d157-4d6a-84a8-1cacf434f215 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] [instance: bbb72400-6c37-4ad3-a470-2925707d0e4b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:06.185738 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b2fb6f06-d157-4d6a-84a8-1cacf434f215 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:06.185738 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b2fb6f06-d157-4d6a-84a8-1cacf434f215 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:06.185738 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b2fb6f06-d157-4d6a-84a8-1cacf434f215 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:06.186901 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b2fb6f06-d157-4d6a-84a8-1cacf434f215 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:06.186901 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b2fb6f06-d157-4d6a-84a8-1cacf434f215 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:06.186901 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b2fb6f06-d157-4d6a-84a8-1cacf434f215 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:06.405102 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-b2fb6f06-d157-4d6a-84a8-1cacf434f215 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561c97996cc4677823df848773232e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82af5eacc6004249910b0e3cbd8b7f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:06.415623 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b2fb6f06-d157-4d6a-84a8-1cacf434f215 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] 10.222.0.82 "GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b" status: 200 len: 1315 microversion: 2.1 time: 0.247279 Aug 24 03:54:06.416439 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 121/246] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:06 2022] GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:06.533241 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-0057221a-002d-4331-9d5d-e3a8ae6be392 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:06.534075 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-0057221a-002d-4331-9d5d-e3a8ae6be392 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 13f1df4b-056e-4637-a0ec-54f6f78c8730] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:06.540741 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0057221a-002d-4331-9d5d-e3a8ae6be392 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:06.541229 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0057221a-002d-4331-9d5d-e3a8ae6be392 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:06.541689 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0057221a-002d-4331-9d5d-e3a8ae6be392 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:06.542379 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0057221a-002d-4331-9d5d-e3a8ae6be392 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:06.542915 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0057221a-002d-4331-9d5d-e3a8ae6be392 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:06.543451 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0057221a-002d-4331-9d5d-e3a8ae6be392 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:07.064154 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-0057221a-002d-4331-9d5d-e3a8ae6be392 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:07.073938 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-0057221a-002d-4331-9d5d-e3a8ae6be392 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730" status: 200 len: 1521 microversion: 2.1 time: 0.544189 Aug 24 03:54:07.087709 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 126/247] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:06 2022] GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730 => generated 1521 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:07.148513 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f24eca97-54a1-4854-b09e-54f683a7f42e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:07.149990 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f24eca97-54a1-4854-b09e-54f683a7f42e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:07.179763 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f24eca97-54a1-4854-b09e-54f683a7f42e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:07.180598 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f24eca97-54a1-4854-b09e-54f683a7f42e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:07.186346 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f24eca97-54a1-4854-b09e-54f683a7f42e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:07.187636 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f24eca97-54a1-4854-b09e-54f683a7f42e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:07.188314 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f24eca97-54a1-4854-b09e-54f683a7f42e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:07.189025 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f24eca97-54a1-4854-b09e-54f683a7f42e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:07.231025 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:07.236445 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f24eca97-54a1-4854-b09e-54f683a7f42e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7/ips" status: 200 len: 152 microversion: 2.20 time: 0.092550 Aug 24 03:54:07.237632 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 122/248] 10.222.0.82 () {60 vars in 1289 bytes} [Wed Aug 24 03:54:07 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7/ips => generated 152 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:54:07.439586 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-99454d31-82ba-4c8e-af2d-4a6990f6719e tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:07.440195 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-99454d31-82ba-4c8e-af2d-4a6990f6719e tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] [instance: bbb72400-6c37-4ad3-a470-2925707d0e4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:07.455303 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-99454d31-82ba-4c8e-af2d-4a6990f6719e tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:07.455795 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-99454d31-82ba-4c8e-af2d-4a6990f6719e tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:07.456226 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-99454d31-82ba-4c8e-af2d-4a6990f6719e tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:07.462018 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-99454d31-82ba-4c8e-af2d-4a6990f6719e tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:07.462595 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-99454d31-82ba-4c8e-af2d-4a6990f6719e tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:07.465565 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-99454d31-82ba-4c8e-af2d-4a6990f6719e tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:07.856893 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-99454d31-82ba-4c8e-af2d-4a6990f6719e tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561c97996cc4677823df848773232e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82af5eacc6004249910b0e3cbd8b7f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:07.880952 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-99454d31-82ba-4c8e-af2d-4a6990f6719e tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] 10.222.0.82 "GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b" status: 200 len: 1315 microversion: 2.1 time: 0.445058 Aug 24 03:54:07.881562 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 127/249] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:07 2022] GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b => generated 1315 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:08.096017 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-32ecdbe8-ec1d-4c67-b043-797a14b75d81 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:08.098466 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-32ecdbe8-ec1d-4c67-b043-797a14b75d81 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 13f1df4b-056e-4637-a0ec-54f6f78c8730] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:08.098938 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:08.106309 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-32ecdbe8-ec1d-4c67-b043-797a14b75d81 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:08.106831 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-32ecdbe8-ec1d-4c67-b043-797a14b75d81 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:08.107467 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-32ecdbe8-ec1d-4c67-b043-797a14b75d81 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:08.109303 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-32ecdbe8-ec1d-4c67-b043-797a14b75d81 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:08.109785 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-32ecdbe8-ec1d-4c67-b043-797a14b75d81 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:08.110221 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-32ecdbe8-ec1d-4c67-b043-797a14b75d81 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:08.599029 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-32ecdbe8-ec1d-4c67-b043-797a14b75d81 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:08.624298 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-32ecdbe8-ec1d-4c67-b043-797a14b75d81 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730" status: 200 len: 1521 microversion: 2.1 time: 0.532132 Aug 24 03:54:08.625303 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 123/250] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:08 2022] GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730 => generated 1521 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:08.903075 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-14eb0ada-eee1-460f-8e3a-c076e0d5b3fa tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:08.903640 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-14eb0ada-eee1-460f-8e3a-c076e0d5b3fa tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] [instance: bbb72400-6c37-4ad3-a470-2925707d0e4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:08.916885 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-14eb0ada-eee1-460f-8e3a-c076e0d5b3fa tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:08.917383 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-14eb0ada-eee1-460f-8e3a-c076e0d5b3fa tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:08.917819 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-14eb0ada-eee1-460f-8e3a-c076e0d5b3fa tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:08.920688 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-14eb0ada-eee1-460f-8e3a-c076e0d5b3fa tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:08.921469 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-14eb0ada-eee1-460f-8e3a-c076e0d5b3fa tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:08.921913 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-14eb0ada-eee1-460f-8e3a-c076e0d5b3fa tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:09.088265 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-14eb0ada-eee1-460f-8e3a-c076e0d5b3fa tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561c97996cc4677823df848773232e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82af5eacc6004249910b0e3cbd8b7f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:09.103258 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-14eb0ada-eee1-460f-8e3a-c076e0d5b3fa tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] 10.222.0.82 "GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b" status: 200 len: 1315 microversion: 2.1 time: 0.204700 Aug 24 03:54:09.107272 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 128/251] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:08 2022] GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:09.652860 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-114fd6db-8c1b-4272-b015-d92a481420b2 req-9461ce26-22f0-4c64-9278-4250f5ebee53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb72400-6c37-4ad3-a470-2925707d0e4b", "name": "network-vif-plugged", "status": "completed", "tag": "394d85c7-7b15-4e67-9132-667fff2085b3"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:09.654914 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-9ef48278-3286-41b0-b669-cced9e73e337 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:09.655823 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-9ef48278-3286-41b0-b669-cced9e73e337 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 13f1df4b-056e-4637-a0ec-54f6f78c8730] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:09.665048 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9ef48278-3286-41b0-b669-cced9e73e337 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:09.666219 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9ef48278-3286-41b0-b669-cced9e73e337 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:09.666789 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9ef48278-3286-41b0-b669-cced9e73e337 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:09.668205 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9ef48278-3286-41b0-b669-cced9e73e337 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:09.668854 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-114fd6db-8c1b-4272-b015-d92a481420b2 req-9461ce26-22f0-4c64-9278-4250f5ebee53 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:09.669364 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-114fd6db-8c1b-4272-b015-d92a481420b2 req-9461ce26-22f0-4c64-9278-4250f5ebee53 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:09.669946 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-114fd6db-8c1b-4272-b015-d92a481420b2 req-9461ce26-22f0-4c64-9278-4250f5ebee53 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:09.670198 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9ef48278-3286-41b0-b669-cced9e73e337 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:09.671500 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9ef48278-3286-41b0-b669-cced9e73e337 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:09.686658 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-114fd6db-8c1b-4272-b015-d92a481420b2 req-9461ce26-22f0-4c64-9278-4250f5ebee53 service nova] Creating event network-vif-plugged:394d85c7-7b15-4e67-9132-667fff2085b3 for instance bbb72400-6c37-4ad3-a470-2925707d0e4b on hv-cinder-85426 Aug 24 03:54:09.695284 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-114fd6db-8c1b-4272-b015-d92a481420b2 req-9461ce26-22f0-4c64-9278-4250f5ebee53 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047143 Aug 24 03:54:09.697892 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 124/252] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:54:09.931803 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-9ef48278-3286-41b0-b669-cced9e73e337 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:09.941342 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-9ef48278-3286-41b0-b669-cced9e73e337 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730" status: 200 len: 1521 microversion: 2.1 time: 0.294184 Aug 24 03:54:09.942007 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 129/253] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:09 2022] GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730 => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:10.125186 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f652e396-db74-4b40-8403-25c5e725d1d8 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:10.126101 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f652e396-db74-4b40-8403-25c5e725d1d8 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] [instance: bbb72400-6c37-4ad3-a470-2925707d0e4b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:10.132630 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f652e396-db74-4b40-8403-25c5e725d1d8 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:10.133111 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f652e396-db74-4b40-8403-25c5e725d1d8 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:10.133592 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f652e396-db74-4b40-8403-25c5e725d1d8 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:10.134293 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f652e396-db74-4b40-8403-25c5e725d1d8 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:10.134774 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f652e396-db74-4b40-8403-25c5e725d1d8 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:10.135193 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f652e396-db74-4b40-8403-25c5e725d1d8 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:10.380230 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-f652e396-db74-4b40-8403-25c5e725d1d8 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561c97996cc4677823df848773232e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82af5eacc6004249910b0e3cbd8b7f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:10.388642 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f652e396-db74-4b40-8403-25c5e725d1d8 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] 10.222.0.82 "GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b" status: 200 len: 1315 microversion: 2.1 time: 0.267581 Aug 24 03:54:10.389555 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 125/254] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:10 2022] GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:10.707695 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-136881d2-6a65-4feb-842c-f3f1da1b310f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:10.708444 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-136881d2-6a65-4feb-842c-f3f1da1b310f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:10.719027 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-136881d2-6a65-4feb-842c-f3f1da1b310f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:10.719979 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-136881d2-6a65-4feb-842c-f3f1da1b310f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:10.721393 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-136881d2-6a65-4feb-842c-f3f1da1b310f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:10.722310 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-136881d2-6a65-4feb-842c-f3f1da1b310f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:10.722793 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-136881d2-6a65-4feb-842c-f3f1da1b310f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:10.723523 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-136881d2-6a65-4feb-842c-f3f1da1b310f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:10.749408 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.objects.instance [None req-136881d2-6a65-4feb-842c-f3f1da1b310f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lazy-loading 'flavor' on Instance uuid b8b22210-7e08-4f01-bf00-d84b0e5e34d7 {{(pid=127869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:54:10.966074 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-41b39c36-de5d-489f-9fb2-43ba91948739 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:10.967773 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-41b39c36-de5d-489f-9fb2-43ba91948739 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 13f1df4b-056e-4637-a0ec-54f6f78c8730] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:10.978667 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-41b39c36-de5d-489f-9fb2-43ba91948739 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:10.979409 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-41b39c36-de5d-489f-9fb2-43ba91948739 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:10.980077 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-41b39c36-de5d-489f-9fb2-43ba91948739 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:10.981476 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-41b39c36-de5d-489f-9fb2-43ba91948739 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:10.982567 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-41b39c36-de5d-489f-9fb2-43ba91948739 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:10.983733 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-41b39c36-de5d-489f-9fb2-43ba91948739 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:11.171965 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-41b39c36-de5d-489f-9fb2-43ba91948739 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:11.192854 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-41b39c36-de5d-489f-9fb2-43ba91948739 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730" status: 200 len: 1521 microversion: 2.1 time: 0.231639 Aug 24 03:54:11.196592 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 126/255] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:10 2022] GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:11.413880 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c95bead3-5e72-4ce5-be1c-688f646164c5 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:11.414559 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c95bead3-5e72-4ce5-be1c-688f646164c5 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] [instance: bbb72400-6c37-4ad3-a470-2925707d0e4b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:11.426450 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c95bead3-5e72-4ce5-be1c-688f646164c5 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:11.427058 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c95bead3-5e72-4ce5-be1c-688f646164c5 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:11.427502 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c95bead3-5e72-4ce5-be1c-688f646164c5 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:11.429678 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c95bead3-5e72-4ce5-be1c-688f646164c5 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:11.430370 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c95bead3-5e72-4ce5-be1c-688f646164c5 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:11.431040 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c95bead3-5e72-4ce5-be1c-688f646164c5 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:11.446323 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-136881d2-6a65-4feb-842c-f3f1da1b310f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "POST /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7/action" status: 202 len: 0 microversion: 2.20 time: 0.743234 Aug 24 03:54:11.447941 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 130/256] 10.222.0.82 () {62 vars in 1319 bytes} [Wed Aug 24 03:54:10 2022] POST /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7/action => generated 0 bytes in 746 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:54:11.464453 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-e2c08345-3f8e-4b9b-a205-63cfe54e583d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:11.465266 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-e2c08345-3f8e-4b9b-a205-63cfe54e583d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:11.472138 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e2c08345-3f8e-4b9b-a205-63cfe54e583d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:11.473135 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e2c08345-3f8e-4b9b-a205-63cfe54e583d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:11.473783 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e2c08345-3f8e-4b9b-a205-63cfe54e583d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:11.475459 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e2c08345-3f8e-4b9b-a205-63cfe54e583d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:11.476172 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e2c08345-3f8e-4b9b-a205-63cfe54e583d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:11.479970 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e2c08345-3f8e-4b9b-a205-63cfe54e583d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:11.643629 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-c95bead3-5e72-4ce5-be1c-688f646164c5 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561c97996cc4677823df848773232e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82af5eacc6004249910b0e3cbd8b7f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:11.652157 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c95bead3-5e72-4ce5-be1c-688f646164c5 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] 10.222.0.82 "GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b" status: 200 len: 1315 microversion: 2.1 time: 0.243461 Aug 24 03:54:11.652731 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 127/257] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:11 2022] GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:11.808376 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-e2c08345-3f8e-4b9b-a205-63cfe54e583d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:11.817279 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-e2c08345-3f8e-4b9b-a205-63cfe54e583d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:11.819683 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-e2c08345-3f8e-4b9b-a205-63cfe54e583d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:11.820919 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-e2c08345-3f8e-4b9b-a205-63cfe54e583d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1724 microversion: 2.20 time: 0.365911 Aug 24 03:54:11.821992 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 131/258] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:11 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1724 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:54:12.217112 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2369a4ad-279b-484c-8ba1-ad18812d9d16 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:12.217728 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2369a4ad-279b-484c-8ba1-ad18812d9d16 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 13f1df4b-056e-4637-a0ec-54f6f78c8730] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:12.224564 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2369a4ad-279b-484c-8ba1-ad18812d9d16 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:12.225317 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2369a4ad-279b-484c-8ba1-ad18812d9d16 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:12.225978 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2369a4ad-279b-484c-8ba1-ad18812d9d16 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:12.226736 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2369a4ad-279b-484c-8ba1-ad18812d9d16 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:12.227197 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2369a4ad-279b-484c-8ba1-ad18812d9d16 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:12.227623 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2369a4ad-279b-484c-8ba1-ad18812d9d16 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:12.373257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-2369a4ad-279b-484c-8ba1-ad18812d9d16 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:12.381613 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2369a4ad-279b-484c-8ba1-ad18812d9d16 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730" status: 200 len: 1521 microversion: 2.1 time: 0.168610 Aug 24 03:54:12.386541 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 128/259] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:12 2022] GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:12.678548 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-e1f3e286-0a0c-46a5-af51-21f71b9692aa tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:12.679739 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-e1f3e286-0a0c-46a5-af51-21f71b9692aa tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] [instance: bbb72400-6c37-4ad3-a470-2925707d0e4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:12.687572 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e1f3e286-0a0c-46a5-af51-21f71b9692aa tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:12.688059 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e1f3e286-0a0c-46a5-af51-21f71b9692aa tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:12.688494 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e1f3e286-0a0c-46a5-af51-21f71b9692aa tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:12.689225 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e1f3e286-0a0c-46a5-af51-21f71b9692aa tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:12.689682 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e1f3e286-0a0c-46a5-af51-21f71b9692aa tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:12.690096 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e1f3e286-0a0c-46a5-af51-21f71b9692aa tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:12.844326 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bdb67c4e-2467-40bc-a6b6-0d03f1b9a14e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:12.844931 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bdb67c4e-2467-40bc-a6b6-0d03f1b9a14e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:12.846046 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-e1f3e286-0a0c-46a5-af51-21f71b9692aa tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561c97996cc4677823df848773232e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82af5eacc6004249910b0e3cbd8b7f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:12.854070 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bdb67c4e-2467-40bc-a6b6-0d03f1b9a14e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:12.854070 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bdb67c4e-2467-40bc-a6b6-0d03f1b9a14e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:12.854070 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bdb67c4e-2467-40bc-a6b6-0d03f1b9a14e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:12.854070 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bdb67c4e-2467-40bc-a6b6-0d03f1b9a14e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:12.854428 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bdb67c4e-2467-40bc-a6b6-0d03f1b9a14e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:12.854428 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bdb67c4e-2467-40bc-a6b6-0d03f1b9a14e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:12.855735 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-e1f3e286-0a0c-46a5-af51-21f71b9692aa tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] 10.222.0.82 "GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b" status: 200 len: 1315 microversion: 2.1 time: 0.185265 Aug 24 03:54:12.856568 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 132/260] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:12 2022] GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:12.994469 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-bdb67c4e-2467-40bc-a6b6-0d03f1b9a14e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:13.004545 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-bdb67c4e-2467-40bc-a6b6-0d03f1b9a14e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:13.007267 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-bdb67c4e-2467-40bc-a6b6-0d03f1b9a14e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:13.008643 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bdb67c4e-2467-40bc-a6b6-0d03f1b9a14e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1724 microversion: 2.20 time: 0.168194 Aug 24 03:54:13.009284 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 129/261] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:12 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:54:13.403152 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-0bb6db13-add6-4190-bc9d-f4b911fc1cc6 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:13.403764 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-0bb6db13-add6-4190-bc9d-f4b911fc1cc6 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 13f1df4b-056e-4637-a0ec-54f6f78c8730] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:13.410091 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0bb6db13-add6-4190-bc9d-f4b911fc1cc6 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:13.410610 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0bb6db13-add6-4190-bc9d-f4b911fc1cc6 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:13.411043 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0bb6db13-add6-4190-bc9d-f4b911fc1cc6 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:13.412625 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0bb6db13-add6-4190-bc9d-f4b911fc1cc6 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:13.413149 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0bb6db13-add6-4190-bc9d-f4b911fc1cc6 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:13.413575 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0bb6db13-add6-4190-bc9d-f4b911fc1cc6 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:13.602599 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-0bb6db13-add6-4190-bc9d-f4b911fc1cc6 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:13.610680 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-0bb6db13-add6-4190-bc9d-f4b911fc1cc6 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730" status: 200 len: 1521 microversion: 2.1 time: 0.211171 Aug 24 03:54:13.611341 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 133/262] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:13 2022] GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:13.883534 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2ece8f1a-a9c1-4228-a037-889d398d64dc tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:13.884169 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2ece8f1a-a9c1-4228-a037-889d398d64dc tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] [instance: bbb72400-6c37-4ad3-a470-2925707d0e4b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:13.890807 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ece8f1a-a9c1-4228-a037-889d398d64dc tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:13.891327 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ece8f1a-a9c1-4228-a037-889d398d64dc tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:13.891711 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ece8f1a-a9c1-4228-a037-889d398d64dc tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:13.900257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ece8f1a-a9c1-4228-a037-889d398d64dc tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:13.900257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ece8f1a-a9c1-4228-a037-889d398d64dc tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:13.900257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ece8f1a-a9c1-4228-a037-889d398d64dc tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:14.033285 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-3cd6ef43-692f-42d2-be19-5878ec66ee93 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:14.033816 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-3cd6ef43-692f-42d2-be19-5878ec66ee93 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:14.039819 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3cd6ef43-692f-42d2-be19-5878ec66ee93 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:14.040295 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3cd6ef43-692f-42d2-be19-5878ec66ee93 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:14.040749 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3cd6ef43-692f-42d2-be19-5878ec66ee93 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:14.041571 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3cd6ef43-692f-42d2-be19-5878ec66ee93 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:14.042274 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3cd6ef43-692f-42d2-be19-5878ec66ee93 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:14.042977 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3cd6ef43-692f-42d2-be19-5878ec66ee93 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:14.065756 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:14.095588 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-2ece8f1a-a9c1-4228-a037-889d398d64dc tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561c97996cc4677823df848773232e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82af5eacc6004249910b0e3cbd8b7f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:14.104763 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2ece8f1a-a9c1-4228-a037-889d398d64dc tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] 10.222.0.82 "GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b" status: 200 len: 1315 microversion: 2.1 time: 0.225805 Aug 24 03:54:14.119553 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 130/263] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:13 2022] GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:14.195031 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-3cd6ef43-692f-42d2-be19-5878ec66ee93 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:14.205575 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-3cd6ef43-692f-42d2-be19-5878ec66ee93 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:14.207856 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-3cd6ef43-692f-42d2-be19-5878ec66ee93 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:14.209194 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-3cd6ef43-692f-42d2-be19-5878ec66ee93 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1724 microversion: 2.20 time: 0.180784 Aug 24 03:54:14.230904 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 134/264] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:14 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:54:14.632149 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-008b7925-4215-4533-9475-cdbfeabb9989 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:14.632832 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-008b7925-4215-4533-9475-cdbfeabb9989 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 13f1df4b-056e-4637-a0ec-54f6f78c8730] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:14.642317 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-008b7925-4215-4533-9475-cdbfeabb9989 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:14.643083 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-008b7925-4215-4533-9475-cdbfeabb9989 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:14.643607 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-008b7925-4215-4533-9475-cdbfeabb9989 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:14.644308 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-008b7925-4215-4533-9475-cdbfeabb9989 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:14.644753 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-008b7925-4215-4533-9475-cdbfeabb9989 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:14.645421 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-008b7925-4215-4533-9475-cdbfeabb9989 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:14.874297 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-008b7925-4215-4533-9475-cdbfeabb9989 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:14.885528 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-008b7925-4215-4533-9475-cdbfeabb9989 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730" status: 200 len: 1521 microversion: 2.1 time: 0.257558 Aug 24 03:54:14.889929 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 131/265] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:14 2022] GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:15.130622 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-38c5544c-ed0c-499b-9426-40e5b40dc324 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:15.131260 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-38c5544c-ed0c-499b-9426-40e5b40dc324 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] [instance: bbb72400-6c37-4ad3-a470-2925707d0e4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:15.147633 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-38c5544c-ed0c-499b-9426-40e5b40dc324 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:15.148578 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-38c5544c-ed0c-499b-9426-40e5b40dc324 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:15.149179 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-38c5544c-ed0c-499b-9426-40e5b40dc324 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:15.150044 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-38c5544c-ed0c-499b-9426-40e5b40dc324 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:15.150668 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-38c5544c-ed0c-499b-9426-40e5b40dc324 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:15.151229 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-38c5544c-ed0c-499b-9426-40e5b40dc324 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:15.248314 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8659aedf-96f8-43cd-8997-6ded2373cd67 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:15.250113 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8659aedf-96f8-43cd-8997-6ded2373cd67 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:15.262337 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8659aedf-96f8-43cd-8997-6ded2373cd67 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:15.264637 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8659aedf-96f8-43cd-8997-6ded2373cd67 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:15.271694 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8659aedf-96f8-43cd-8997-6ded2373cd67 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:15.271694 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8659aedf-96f8-43cd-8997-6ded2373cd67 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:15.271694 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8659aedf-96f8-43cd-8997-6ded2373cd67 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:15.271694 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8659aedf-96f8-43cd-8997-6ded2373cd67 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:15.556040 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-38c5544c-ed0c-499b-9426-40e5b40dc324 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561c97996cc4677823df848773232e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82af5eacc6004249910b0e3cbd8b7f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:15.563599 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-8659aedf-96f8-43cd-8997-6ded2373cd67 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:15.575433 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-8659aedf-96f8-43cd-8997-6ded2373cd67 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:15.576972 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-8659aedf-96f8-43cd-8997-6ded2373cd67 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:15.578170 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8659aedf-96f8-43cd-8997-6ded2373cd67 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1724 microversion: 2.20 time: 0.338954 Aug 24 03:54:15.591061 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 132/266] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:15 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1724 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:54:15.595969 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-38c5544c-ed0c-499b-9426-40e5b40dc324 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] 10.222.0.82 "GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b" status: 200 len: 1464 microversion: 2.1 time: 0.469480 Aug 24 03:54:15.597062 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 135/267] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:15 2022] GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b => generated 1464 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:15.611786 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e368397f-f189-490f-9c45-da2768963924 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:15.612279 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e368397f-f189-490f-9c45-da2768963924 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:15.633551 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e368397f-f189-490f-9c45-da2768963924 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:15.634121 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e368397f-f189-490f-9c45-da2768963924 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:15.637547 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e368397f-f189-490f-9c45-da2768963924 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:15.638386 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e368397f-f189-490f-9c45-da2768963924 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:15.639254 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e368397f-f189-490f-9c45-da2768963924 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:15.640469 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e368397f-f189-490f-9c45-da2768963924 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:15.678634 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-ba40a028-0243-4517-8482-7dff3b56ef62 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:15.679136 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-ba40a028-0243-4517-8482-7dff3b56ef62 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] [instance: bbb72400-6c37-4ad3-a470-2925707d0e4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:15.691857 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ba40a028-0243-4517-8482-7dff3b56ef62 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:15.692349 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ba40a028-0243-4517-8482-7dff3b56ef62 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:15.697946 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e368397f-f189-490f-9c45-da2768963924 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6/ips" status: 200 len: 146 microversion: 2.1 time: 0.101018 Aug 24 03:54:15.698540 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 133/268] 10.222.0.82 () {58 vars in 1248 bytes} [Wed Aug 24 03:54:15 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6/ips => generated 146 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:54:15.704853 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ba40a028-0243-4517-8482-7dff3b56ef62 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:15.707076 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ba40a028-0243-4517-8482-7dff3b56ef62 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:15.707571 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ba40a028-0243-4517-8482-7dff3b56ef62 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:15.708009 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ba40a028-0243-4517-8482-7dff3b56ef62 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:15.792237 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-ba40a028-0243-4517-8482-7dff3b56ef62 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] [instance: bbb72400-6c37-4ad3-a470-2925707d0e4b] Going to try to terminate instance {{(pid=127869) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:54:15.913119 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-327057b4-5df2-4f10-9900-2494dd5ca157 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:15.914914 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-327057b4-5df2-4f10-9900-2494dd5ca157 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 13f1df4b-056e-4637-a0ec-54f6f78c8730] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:15.932581 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-327057b4-5df2-4f10-9900-2494dd5ca157 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:15.932581 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-327057b4-5df2-4f10-9900-2494dd5ca157 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:15.932581 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-327057b4-5df2-4f10-9900-2494dd5ca157 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:15.932581 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-327057b4-5df2-4f10-9900-2494dd5ca157 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:15.933130 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-327057b4-5df2-4f10-9900-2494dd5ca157 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:15.933130 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-327057b4-5df2-4f10-9900-2494dd5ca157 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:16.176235 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-327057b4-5df2-4f10-9900-2494dd5ca157 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:16.188203 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-327057b4-5df2-4f10-9900-2494dd5ca157 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730" status: 200 len: 1521 microversion: 2.1 time: 0.279922 Aug 24 03:54:16.190123 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 134/269] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:15 2022] GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730 => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:16.401257 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-ba40a028-0243-4517-8482-7dff3b56ef62 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] 10.222.0.82 "DELETE /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b" status: 204 len: 0 microversion: 2.1 time: 0.727096 Aug 24 03:54:16.401944 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 136/270] 10.222.0.82 () {58 vars in 1239 bytes} [Wed Aug 24 03:54:15 2022] DELETE /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b => generated 0 bytes in 729 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:54:16.415708 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4b521176-0623-457c-bea6-55621aa49380 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:16.416493 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4b521176-0623-457c-bea6-55621aa49380 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] [instance: bbb72400-6c37-4ad3-a470-2925707d0e4b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:16.433423 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4b521176-0623-457c-bea6-55621aa49380 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:16.434188 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4b521176-0623-457c-bea6-55621aa49380 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:16.435198 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4b521176-0623-457c-bea6-55621aa49380 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:16.436071 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4b521176-0623-457c-bea6-55621aa49380 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:16.439172 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4b521176-0623-457c-bea6-55621aa49380 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:16.439835 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4b521176-0623-457c-bea6-55621aa49380 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:16.604035 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-4b875217-09fd-4ecc-89ad-7879979d595c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:16.604581 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-4b875217-09fd-4ecc-89ad-7879979d595c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:16.611816 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4b875217-09fd-4ecc-89ad-7879979d595c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:16.615264 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4b875217-09fd-4ecc-89ad-7879979d595c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:16.615264 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4b875217-09fd-4ecc-89ad-7879979d595c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:16.615264 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4b875217-09fd-4ecc-89ad-7879979d595c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:16.615264 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4b875217-09fd-4ecc-89ad-7879979d595c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:16.616326 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4b875217-09fd-4ecc-89ad-7879979d595c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:16.668873 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-4b521176-0623-457c-bea6-55621aa49380 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561c97996cc4677823df848773232e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82af5eacc6004249910b0e3cbd8b7f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:16.679952 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4b521176-0623-457c-bea6-55621aa49380 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] 10.222.0.82 "GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b" status: 200 len: 1470 microversion: 2.1 time: 0.270354 Aug 24 03:54:16.682612 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 135/271] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:16 2022] GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b => generated 1470 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:16.697632 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-207a6eb9-5c52-4ae7-9b77-af843610822a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:16.698721 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-207a6eb9-5c52-4ae7-9b77-af843610822a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:16.706132 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-207a6eb9-5c52-4ae7-9b77-af843610822a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:16.706673 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-207a6eb9-5c52-4ae7-9b77-af843610822a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:16.707110 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-207a6eb9-5c52-4ae7-9b77-af843610822a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:16.707833 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-207a6eb9-5c52-4ae7-9b77-af843610822a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:16.708428 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-207a6eb9-5c52-4ae7-9b77-af843610822a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:16.709583 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-207a6eb9-5c52-4ae7-9b77-af843610822a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:16.739127 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-207a6eb9-5c52-4ae7-9b77-af843610822a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b/ips" status: 200 len: 151 microversion: 2.1 time: 0.050088 Aug 24 03:54:16.741532 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 136/272] 10.222.0.82 () {58 vars in 1248 bytes} [Wed Aug 24 03:54:16 2022] GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b/ips => generated 151 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:54:16.915785 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-4b875217-09fd-4ecc-89ad-7879979d595c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:16.932246 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-4b875217-09fd-4ecc-89ad-7879979d595c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:16.934030 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-4b875217-09fd-4ecc-89ad-7879979d595c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:16.937873 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-4b875217-09fd-4ecc-89ad-7879979d595c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1724 microversion: 2.20 time: 0.337768 Aug 24 03:54:16.937873 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 137/273] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:16 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1724 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:54:17.211881 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a9bdd447-0f09-491b-ae0b-34d3d2885fe9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:17.212497 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a9bdd447-0f09-491b-ae0b-34d3d2885fe9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 13f1df4b-056e-4637-a0ec-54f6f78c8730] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:17.219996 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a9bdd447-0f09-491b-ae0b-34d3d2885fe9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:17.220761 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a9bdd447-0f09-491b-ae0b-34d3d2885fe9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:17.221400 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a9bdd447-0f09-491b-ae0b-34d3d2885fe9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:17.222328 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a9bdd447-0f09-491b-ae0b-34d3d2885fe9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:17.223040 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a9bdd447-0f09-491b-ae0b-34d3d2885fe9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:17.223710 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a9bdd447-0f09-491b-ae0b-34d3d2885fe9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:17.409802 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-a9bdd447-0f09-491b-ae0b-34d3d2885fe9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:17.425873 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a9bdd447-0f09-491b-ae0b-34d3d2885fe9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730" status: 200 len: 1521 microversion: 2.1 time: 0.218559 Aug 24 03:54:17.432908 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 137/274] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:17 2022] GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:17.709992 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-b3e94dab-a10c-4589-be2c-969a185ff565 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:17.712861 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-b3e94dab-a10c-4589-be2c-969a185ff565 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] [instance: bbb72400-6c37-4ad3-a470-2925707d0e4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:17.730462 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b3e94dab-a10c-4589-be2c-969a185ff565 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:17.733162 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b3e94dab-a10c-4589-be2c-969a185ff565 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:17.736070 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b3e94dab-a10c-4589-be2c-969a185ff565 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:17.738256 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b3e94dab-a10c-4589-be2c-969a185ff565 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:17.739031 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b3e94dab-a10c-4589-be2c-969a185ff565 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:17.741315 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b3e94dab-a10c-4589-be2c-969a185ff565 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:17.929031 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-b3e94dab-a10c-4589-be2c-969a185ff565 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561c97996cc4677823df848773232e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82af5eacc6004249910b0e3cbd8b7f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:17.938803 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-b3e94dab-a10c-4589-be2c-969a185ff565 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] 10.222.0.82 "GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b" status: 200 len: 1470 microversion: 2.1 time: 0.240420 Aug 24 03:54:17.939850 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 138/275] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:17 2022] GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b => generated 1470 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:17.962043 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ad2722c8-332d-46b7-87a9-af3cc4a4bd60 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:17.963995 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ad2722c8-332d-46b7-87a9-af3cc4a4bd60 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:17.972871 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad2722c8-332d-46b7-87a9-af3cc4a4bd60 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:17.975301 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad2722c8-332d-46b7-87a9-af3cc4a4bd60 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:17.982955 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad2722c8-332d-46b7-87a9-af3cc4a4bd60 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:17.984357 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad2722c8-332d-46b7-87a9-af3cc4a4bd60 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:17.985272 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad2722c8-332d-46b7-87a9-af3cc4a4bd60 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:17.986146 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad2722c8-332d-46b7-87a9-af3cc4a4bd60 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:18.326289 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-ad2722c8-332d-46b7-87a9-af3cc4a4bd60 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:18.342571 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-ad2722c8-332d-46b7-87a9-af3cc4a4bd60 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:18.344774 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-ad2722c8-332d-46b7-87a9-af3cc4a4bd60 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:18.346179 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ad2722c8-332d-46b7-87a9-af3cc4a4bd60 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1724 microversion: 2.20 time: 0.390146 Aug 24 03:54:18.359487 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 138/276] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:17 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1724 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:54:18.450310 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-43f071d7-06ff-487a-b6d9-c327bc6443a5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:18.451767 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-43f071d7-06ff-487a-b6d9-c327bc6443a5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 13f1df4b-056e-4637-a0ec-54f6f78c8730] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:18.458837 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-43f071d7-06ff-487a-b6d9-c327bc6443a5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:18.459272 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-43f071d7-06ff-487a-b6d9-c327bc6443a5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:18.459874 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-43f071d7-06ff-487a-b6d9-c327bc6443a5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:18.460581 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-43f071d7-06ff-487a-b6d9-c327bc6443a5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:18.461167 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-43f071d7-06ff-487a-b6d9-c327bc6443a5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:18.461633 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-43f071d7-06ff-487a-b6d9-c327bc6443a5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:18.612924 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-43f071d7-06ff-487a-b6d9-c327bc6443a5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:18.622349 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-43f071d7-06ff-487a-b6d9-c327bc6443a5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730" status: 200 len: 1521 microversion: 2.1 time: 0.177727 Aug 24 03:54:18.622964 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 139/277] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:18 2022] GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:18.960899 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-95a1a874-a281-45c3-a811-81ce7e6717d9 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:18.961684 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-95a1a874-a281-45c3-a811-81ce7e6717d9 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] [instance: bbb72400-6c37-4ad3-a470-2925707d0e4b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:18.979726 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-95a1a874-a281-45c3-a811-81ce7e6717d9 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:18.979726 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-95a1a874-a281-45c3-a811-81ce7e6717d9 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:18.979726 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-95a1a874-a281-45c3-a811-81ce7e6717d9 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:18.979726 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-95a1a874-a281-45c3-a811-81ce7e6717d9 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:18.980063 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-95a1a874-a281-45c3-a811-81ce7e6717d9 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:18.980063 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-95a1a874-a281-45c3-a811-81ce7e6717d9 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:19.227071 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-95a1a874-a281-45c3-a811-81ce7e6717d9 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561c97996cc4677823df848773232e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82af5eacc6004249910b0e3cbd8b7f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:19.236536 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-95a1a874-a281-45c3-a811-81ce7e6717d9 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] 10.222.0.82 "GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b" status: 200 len: 1470 microversion: 2.1 time: 0.280018 Aug 24 03:54:19.237214 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 139/278] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:18 2022] GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b => generated 1470 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:19.373921 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-68af6014-f45e-403b-bac3-819692994165 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:19.374725 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-68af6014-f45e-403b-bac3-819692994165 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:19.383088 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-68af6014-f45e-403b-bac3-819692994165 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:19.383799 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-68af6014-f45e-403b-bac3-819692994165 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:19.384429 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-68af6014-f45e-403b-bac3-819692994165 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:19.385164 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-68af6014-f45e-403b-bac3-819692994165 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:19.385770 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-68af6014-f45e-403b-bac3-819692994165 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:19.386193 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-68af6014-f45e-403b-bac3-819692994165 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:19.538222 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-68af6014-f45e-403b-bac3-819692994165 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:19.548983 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-68af6014-f45e-403b-bac3-819692994165 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:19.550484 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-68af6014-f45e-403b-bac3-819692994165 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:19.552295 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-68af6014-f45e-403b-bac3-819692994165 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1724 microversion: 2.20 time: 0.182544 Aug 24 03:54:19.552856 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 140/279] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:19 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:54:19.643933 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0f119cba-7769-4cb5-830c-371a520a86bd tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:19.644859 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0f119cba-7769-4cb5-830c-371a520a86bd tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 13f1df4b-056e-4637-a0ec-54f6f78c8730] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:19.652528 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0f119cba-7769-4cb5-830c-371a520a86bd tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:19.653223 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0f119cba-7769-4cb5-830c-371a520a86bd tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:19.653818 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0f119cba-7769-4cb5-830c-371a520a86bd tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:19.654817 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0f119cba-7769-4cb5-830c-371a520a86bd tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:19.655463 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0f119cba-7769-4cb5-830c-371a520a86bd tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:19.656032 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0f119cba-7769-4cb5-830c-371a520a86bd tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:19.676266 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:19.908797 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-0f119cba-7769-4cb5-830c-371a520a86bd tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:19.917715 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0f119cba-7769-4cb5-830c-371a520a86bd tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730" status: 200 len: 1521 microversion: 2.1 time: 0.277651 Aug 24 03:54:19.922684 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 140/280] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:19 2022] GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730 => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:20.273575 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-3f5dcdc2-0d08-45f7-898e-c3f4e8ad7cf0 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:20.273575 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-3f5dcdc2-0d08-45f7-898e-c3f4e8ad7cf0 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] [instance: bbb72400-6c37-4ad3-a470-2925707d0e4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:20.273575 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3f5dcdc2-0d08-45f7-898e-c3f4e8ad7cf0 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:20.273575 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3f5dcdc2-0d08-45f7-898e-c3f4e8ad7cf0 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:20.274292 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3f5dcdc2-0d08-45f7-898e-c3f4e8ad7cf0 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:20.274292 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3f5dcdc2-0d08-45f7-898e-c3f4e8ad7cf0 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:20.274292 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3f5dcdc2-0d08-45f7-898e-c3f4e8ad7cf0 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:20.274292 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3f5dcdc2-0d08-45f7-898e-c3f4e8ad7cf0 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:20.436827 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-3f5dcdc2-0d08-45f7-898e-c3f4e8ad7cf0 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561c97996cc4677823df848773232e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82af5eacc6004249910b0e3cbd8b7f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:20.446860 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-3f5dcdc2-0d08-45f7-898e-c3f4e8ad7cf0 tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] 10.222.0.82 "GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b" status: 200 len: 1470 microversion: 2.1 time: 0.192416 Aug 24 03:54:20.448339 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 141/281] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:20 2022] GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b => generated 1470 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:20.576540 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d8da96e9-3841-4f3e-9f62-df55b91b09bc tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:20.577541 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d8da96e9-3841-4f3e-9f62-df55b91b09bc tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:20.590115 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d8da96e9-3841-4f3e-9f62-df55b91b09bc tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:20.590782 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d8da96e9-3841-4f3e-9f62-df55b91b09bc tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:20.591480 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d8da96e9-3841-4f3e-9f62-df55b91b09bc tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:20.592649 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d8da96e9-3841-4f3e-9f62-df55b91b09bc tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:20.593357 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d8da96e9-3841-4f3e-9f62-df55b91b09bc tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:20.595704 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d8da96e9-3841-4f3e-9f62-df55b91b09bc tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:20.831100 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-d8da96e9-3841-4f3e-9f62-df55b91b09bc tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:20.841739 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-d8da96e9-3841-4f3e-9f62-df55b91b09bc tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:20.843338 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-d8da96e9-3841-4f3e-9f62-df55b91b09bc tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:20.844631 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d8da96e9-3841-4f3e-9f62-df55b91b09bc tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1724 microversion: 2.20 time: 0.272200 Aug 24 03:54:20.851741 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 141/282] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:20 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1724 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:54:20.940439 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-63f55fb2-db90-4c03-aec8-77da4ba80475 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:20.941445 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-63f55fb2-db90-4c03-aec8-77da4ba80475 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 13f1df4b-056e-4637-a0ec-54f6f78c8730] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:20.949726 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-63f55fb2-db90-4c03-aec8-77da4ba80475 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:20.952085 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-63f55fb2-db90-4c03-aec8-77da4ba80475 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:20.953179 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-63f55fb2-db90-4c03-aec8-77da4ba80475 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:20.955054 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-63f55fb2-db90-4c03-aec8-77da4ba80475 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:20.955842 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-63f55fb2-db90-4c03-aec8-77da4ba80475 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:20.956424 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-63f55fb2-db90-4c03-aec8-77da4ba80475 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:20.995051 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0be75daf-8e1c-46ab-a166-fb597f1bc077 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06095bd4-0045-4e25-9218-6054073d94e4"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:20.998651 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0be75daf-8e1c-46ab-a166-fb597f1bc077 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:21.023688 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0be75daf-8e1c-46ab-a166-fb597f1bc077 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:21.024223 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0be75daf-8e1c-46ab-a166-fb597f1bc077 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:21.024727 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0be75daf-8e1c-46ab-a166-fb597f1bc077 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:21.025494 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0be75daf-8e1c-46ab-a166-fb597f1bc077 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:21.026179 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0be75daf-8e1c-46ab-a166-fb597f1bc077 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:21.026845 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0be75daf-8e1c-46ab-a166-fb597f1bc077 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:21.242070 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-63f55fb2-db90-4c03-aec8-77da4ba80475 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:21.254914 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-63f55fb2-db90-4c03-aec8-77da4ba80475 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730" status: 200 len: 1521 microversion: 2.1 time: 0.316934 Aug 24 03:54:21.258680 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 142/283] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:20 2022] GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730 => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:21.276129 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-bc7d6c5f-03c1-4ce2-9c64-6def890c8579 req-070b9357-2d46-4f95-9e58-204f48b6c882 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb72400-6c37-4ad3-a470-2925707d0e4b", "name": "network-vif-deleted", "tag": "394d85c7-7b15-4e67-9132-667fff2085b3"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:21.297259 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-bc7d6c5f-03c1-4ce2-9c64-6def890c8579 req-070b9357-2d46-4f95-9e58-204f48b6c882 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:21.297729 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-bc7d6c5f-03c1-4ce2-9c64-6def890c8579 req-070b9357-2d46-4f95-9e58-204f48b6c882 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:21.298229 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-bc7d6c5f-03c1-4ce2-9c64-6def890c8579 req-070b9357-2d46-4f95-9e58-204f48b6c882 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:21.323986 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-bc7d6c5f-03c1-4ce2-9c64-6def890c8579 req-070b9357-2d46-4f95-9e58-204f48b6c882 service nova] Creating event network-vif-deleted:394d85c7-7b15-4e67-9132-667fff2085b3 for instance bbb72400-6c37-4ad3-a470-2925707d0e4b on hv-cinder-85426 Aug 24 03:54:21.347235 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-bc7d6c5f-03c1-4ce2-9c64-6def890c8579 req-070b9357-2d46-4f95-9e58-204f48b6c882 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063807 Aug 24 03:54:21.347235 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 143/284] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:54:21.423703 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-f96d08b0-1cd4-4400-8796-f4c75f0891ea tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5aeabfee-2ba2-480b-ac82-d66ed0ea05a0"}} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:21.429569 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-f96d08b0-1cd4-4400-8796-f4c75f0891ea tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:21.437168 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f96d08b0-1cd4-4400-8796-f4c75f0891ea tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:21.438753 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f96d08b0-1cd4-4400-8796-f4c75f0891ea tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:21.439776 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f96d08b0-1cd4-4400-8796-f4c75f0891ea tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:21.441123 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f96d08b0-1cd4-4400-8796-f4c75f0891ea tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:21.441764 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f96d08b0-1cd4-4400-8796-f4c75f0891ea tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:21.443369 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f96d08b0-1cd4-4400-8796-f4c75f0891ea tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:23.657228 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0be75daf-8e1c-46ab-a166-fb597f1bc077 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "POST /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.666839 Aug 24 03:54:23.658762 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 142/285] 10.222.0.82 () {60 vars in 1323 bytes} [Wed Aug 24 03:54:20 2022] POST /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b/os-volume_attachments => generated 194 bytes in 2669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:54:23.672160 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-354efdaa-aa6e-4b95-8281-a807c5380b7c tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:23.674542 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-354efdaa-aa6e-4b95-8281-a807c5380b7c tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] [instance: bbb72400-6c37-4ad3-a470-2925707d0e4b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:23.693398 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-354efdaa-aa6e-4b95-8281-a807c5380b7c tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:23.693984 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-354efdaa-aa6e-4b95-8281-a807c5380b7c tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:23.694654 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-354efdaa-aa6e-4b95-8281-a807c5380b7c tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:23.698469 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-354efdaa-aa6e-4b95-8281-a807c5380b7c tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:23.699043 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-354efdaa-aa6e-4b95-8281-a807c5380b7c tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:23.699683 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-354efdaa-aa6e-4b95-8281-a807c5380b7c tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:23.784724 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-354efdaa-aa6e-4b95-8281-a807c5380b7c tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:23.788734 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-354efdaa-aa6e-4b95-8281-a807c5380b7c tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:23.789535 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-354efdaa-aa6e-4b95-8281-a807c5380b7c tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:23.790800 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-354efdaa-aa6e-4b95-8281-a807c5380b7c tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lazy-loading 'fault' on Instance uuid bbb72400-6c37-4ad3-a470-2925707d0e4b {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:54:23.858829 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-354efdaa-aa6e-4b95-8281-a807c5380b7c tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561c97996cc4677823df848773232e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82af5eacc6004249910b0e3cbd8b7f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:23.868638 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-354efdaa-aa6e-4b95-8281-a807c5380b7c tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] 10.222.0.82 "GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b" status: 200 len: 1305 microversion: 2.1 time: 0.208371 Aug 24 03:54:23.883724 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 143/286] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:23 2022] GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b => generated 1305 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:23.883724 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-451cfd0d-51f9-485c-b4ac-8a876ef8661f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:23.883724 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-451cfd0d-51f9-485c-b4ac-8a876ef8661f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:23.885128 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-451cfd0d-51f9-485c-b4ac-8a876ef8661f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:23.885595 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-451cfd0d-51f9-485c-b4ac-8a876ef8661f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:23.886261 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-451cfd0d-51f9-485c-b4ac-8a876ef8661f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:23.887234 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-451cfd0d-51f9-485c-b4ac-8a876ef8661f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:23.887872 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-451cfd0d-51f9-485c-b4ac-8a876ef8661f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:23.888479 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-451cfd0d-51f9-485c-b4ac-8a876ef8661f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:24.058274 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-451cfd0d-51f9-485c-b4ac-8a876ef8661f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:24.069498 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-451cfd0d-51f9-485c-b4ac-8a876ef8661f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:24.071245 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-451cfd0d-51f9-485c-b4ac-8a876ef8661f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:24.075331 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-451cfd0d-51f9-485c-b4ac-8a876ef8661f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1724 microversion: 2.20 time: 0.205112 Aug 24 03:54:24.076733 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 144/287] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:23 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:54:24.082928 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-534efafe-b693-4b02-9e75-610090ae884e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:24.083582 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-534efafe-b693-4b02-9e75-610090ae884e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 13f1df4b-056e-4637-a0ec-54f6f78c8730] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:24.091184 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-534efafe-b693-4b02-9e75-610090ae884e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:24.091942 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-534efafe-b693-4b02-9e75-610090ae884e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:24.092584 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-534efafe-b693-4b02-9e75-610090ae884e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:24.093493 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-534efafe-b693-4b02-9e75-610090ae884e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:24.094137 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-534efafe-b693-4b02-9e75-610090ae884e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:24.094783 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-534efafe-b693-4b02-9e75-610090ae884e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:24.113182 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-f96d08b0-1cd4-4400-8796-f4c75f0891ea tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "POST /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.693636 Aug 24 03:54:24.118703 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 144/288] 10.222.0.82 () {60 vars in 1323 bytes} [Wed Aug 24 03:54:21 2022] POST /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6/os-volume_attachments => generated 194 bytes in 2698 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:54:24.321362 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-534efafe-b693-4b02-9e75-610090ae884e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:24.346207 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-534efafe-b693-4b02-9e75-610090ae884e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730" status: 200 len: 1521 microversion: 2.1 time: 0.255704 Aug 24 03:54:24.346207 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 145/289] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:24 2022] GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730 => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:24.891040 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-2ab012d3-1eec-433b-b54f-cd50794f7cca tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:24.891747 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-2ab012d3-1eec-433b-b54f-cd50794f7cca tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] [instance: bbb72400-6c37-4ad3-a470-2925707d0e4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:24.899345 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2ab012d3-1eec-433b-b54f-cd50794f7cca tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:24.899862 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2ab012d3-1eec-433b-b54f-cd50794f7cca tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:24.900295 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2ab012d3-1eec-433b-b54f-cd50794f7cca tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:24.901002 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2ab012d3-1eec-433b-b54f-cd50794f7cca tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:24.901457 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2ab012d3-1eec-433b-b54f-cd50794f7cca tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:24.901880 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2ab012d3-1eec-433b-b54f-cd50794f7cca tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:24.918688 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.wsgi [None req-2ab012d3-1eec-433b-b54f-cd50794f7cca tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] HTTP exception thrown: Instance bbb72400-6c37-4ad3-a470-2925707d0e4b could not be found. Aug 24 03:54:24.920360 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-2ab012d3-1eec-433b-b54f-cd50794f7cca tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Request method failure captured: Aug 24 03:54:24.920360 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: request: GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b HTTP/1.1 Aug 24 03:54:24.920360 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept: application/json Aug 24 03:54:24.920360 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept-Encoding: identity Aug 24 03:54:24.920360 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Connection: close Aug 24 03:54:24.920360 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Length: 0 Aug 24 03:54:24.920360 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Type: application/json Aug 24 03:54:24.920360 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Host: 10.222.0.82 Aug 24 03:54:24.920360 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Openstack-System-Scope: None Aug 24 03:54:24.920360 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: User-Agent: python-urllib3/1.26.11 Aug 24 03:54:24.920360 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Auth-Token: gAAAAABjBaDKwexUSqzS1qQFXXCwExjJ_zfvinZtkX8YHlxDu8uLWmRI0TgIArXa-O8g3_J5G7hQmXZ2Cj7cTx98cHQnVyaItumCV67W86SOpln59Y4yY2ct_X0ljxNXgq0Tps1OvLWPSfo9zY7PFBZCBfeLp0p10-jmFoEOzJ5TF3CrzZVBO08 Aug 24 03:54:24.920360 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Id: None Aug 24 03:54:24.920360 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Name: None Aug 24 03:54:24.920360 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Identity-Status: Confirmed Aug 24 03:54:24.920360 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Is-Admin-Project: True Aug 24 03:54:24.920360 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Id: default Aug 24 03:54:24.920360 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Name: Default Aug 24 03:54:24.920360 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Id: 82af5eacc6004249910b0e3cbd8b7f34 Aug 24 03:54:24.920360 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Name: tempest-VolumesNegativeTest-97847936 Aug 24 03:54:24.920360 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Role: member,reader Aug 24 03:54:24.920360 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Roles: member,reader Aug 24 03:54:24.921597 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/82af5eacc6004249910b0e3cbd8b7f34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/82af5eacc6004249910b0e3cbd8b7f34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/82af5eacc6004249910b0e3cbd8b7f34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_82af5eacc6004249910b0e3cbd8b7f34", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:54:24.921597 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant: tempest-VolumesNegativeTest-97847936 Aug 24 03:54:24.921597 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Id: 82af5eacc6004249910b0e3cbd8b7f34 Aug 24 03:54:24.921597 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Name: tempest-VolumesNegativeTest-97847936 Aug 24 03:54:24.921597 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User: tempest-VolumesNegativeTest-97847936-project Aug 24 03:54:24.921597 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Id: default Aug 24 03:54:24.921597 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Name: Default Aug 24 03:54:24.921597 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Id: a561c97996cc4677823df848773232e6 Aug 24 03:54:24.921597 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Name: tempest-VolumesNegativeTest-97847936-project Aug 24 03:54:24.921597 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: method: > Aug 24 03:54:24.921597 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: exception: Instance bbb72400-6c37-4ad3-a470-2925707d0e4b could not be found. Aug 24 03:54:24.921597 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: action_args: {'id': 'bbb72400-6c37-4ad3-a470-2925707d0e4b'} Aug 24 03:54:24.922380 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:54:24.922380 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:24.922380 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:54:24.922380 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:54:24.922380 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:54:24.922380 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:54:24.922380 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:54:24.922380 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:54:24.922380 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:54:24.922380 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:54:24.922380 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbb72400-6c37-4ad3-a470-2925707d0e4b could not be found. Aug 24 03:54:24.922380 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:54:24.922380 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:24.922380 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:54:24.922380 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:24.922380 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:24.922380 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:24.922380 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:54:24.922380 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:54:24.922380 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:54:24.923604 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:54:24.923604 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:54:24.923604 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:54:24.923604 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:54:24.923604 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:54:24.923604 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:54:24.923604 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:54:24.923604 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbb72400-6c37-4ad3-a470-2925707d0e4b could not be found. Aug 24 03:54:24.923604 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:54:24.923604 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:24.923604 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:54:24.923604 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:24.923604 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:24.923604 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:24.923604 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:54:24.923604 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:54:24.923604 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbb72400-6c37-4ad3-a470-2925707d0e4b could not be found. Aug 24 03:54:24.923604 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:54:24.924630 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-2ab012d3-1eec-433b-b54f-cd50794f7cca tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] Returning 404 to user: Instance bbb72400-6c37-4ad3-a470-2925707d0e4b could not be found. {{(pid=127869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:54:24.924630 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-2ab012d3-1eec-433b-b54f-cd50794f7cca tempest-VolumesNegativeTest-97847936 tempest-VolumesNegativeTest-97847936-project] 10.222.0.82 "GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b" status: 404 len: 111 microversion: 2.1 time: 0.035983 Aug 24 03:54:24.924630 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 145/290] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:24 2022] GET /compute/v2.1/servers/bbb72400-6c37-4ad3-a470-2925707d0e4b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:54:25.103567 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d0f5adef-3488-4548-81ae-8ef73ba9b8bb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:25.104174 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d0f5adef-3488-4548-81ae-8ef73ba9b8bb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:25.110755 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d0f5adef-3488-4548-81ae-8ef73ba9b8bb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:25.111278 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d0f5adef-3488-4548-81ae-8ef73ba9b8bb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:25.111714 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d0f5adef-3488-4548-81ae-8ef73ba9b8bb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:25.112397 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d0f5adef-3488-4548-81ae-8ef73ba9b8bb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:25.112846 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d0f5adef-3488-4548-81ae-8ef73ba9b8bb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:25.113341 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d0f5adef-3488-4548-81ae-8ef73ba9b8bb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:25.247558 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-d0f5adef-3488-4548-81ae-8ef73ba9b8bb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:25.256313 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-d0f5adef-3488-4548-81ae-8ef73ba9b8bb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:25.257838 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-d0f5adef-3488-4548-81ae-8ef73ba9b8bb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:25.259036 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d0f5adef-3488-4548-81ae-8ef73ba9b8bb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1724 microversion: 2.20 time: 0.160223 Aug 24 03:54:25.259596 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 146/291] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:25 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:54:25.380153 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-8cb4c770-30a5-47e7-8113-6cae9f683ff3 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:25.380153 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-8cb4c770-30a5-47e7-8113-6cae9f683ff3 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 13f1df4b-056e-4637-a0ec-54f6f78c8730] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:25.380153 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8cb4c770-30a5-47e7-8113-6cae9f683ff3 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:25.380153 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8cb4c770-30a5-47e7-8113-6cae9f683ff3 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:25.380915 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8cb4c770-30a5-47e7-8113-6cae9f683ff3 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:25.380915 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8cb4c770-30a5-47e7-8113-6cae9f683ff3 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:25.380915 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8cb4c770-30a5-47e7-8113-6cae9f683ff3 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:25.380915 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8cb4c770-30a5-47e7-8113-6cae9f683ff3 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:25.572239 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-8cb4c770-30a5-47e7-8113-6cae9f683ff3 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:25.581091 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-8cb4c770-30a5-47e7-8113-6cae9f683ff3 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730" status: 200 len: 1521 microversion: 2.1 time: 0.219871 Aug 24 03:54:25.595070 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 146/292] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:25 2022] GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:26.284945 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e41d3f67-2d64-44ca-96cc-f64d6533436d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:26.286599 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e41d3f67-2d64-44ca-96cc-f64d6533436d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:26.295486 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e41d3f67-2d64-44ca-96cc-f64d6533436d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:26.296180 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e41d3f67-2d64-44ca-96cc-f64d6533436d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:26.299837 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e41d3f67-2d64-44ca-96cc-f64d6533436d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:26.299837 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e41d3f67-2d64-44ca-96cc-f64d6533436d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:26.299837 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e41d3f67-2d64-44ca-96cc-f64d6533436d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:26.299837 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e41d3f67-2d64-44ca-96cc-f64d6533436d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:26.464435 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-e41d3f67-2d64-44ca-96cc-f64d6533436d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:26.477766 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-e41d3f67-2d64-44ca-96cc-f64d6533436d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:26.479628 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-e41d3f67-2d64-44ca-96cc-f64d6533436d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:26.482042 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e41d3f67-2d64-44ca-96cc-f64d6533436d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1724 microversion: 2.20 time: 0.201029 Aug 24 03:54:26.483156 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 147/293] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:26 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:54:26.609435 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-f7a3b64e-3074-4a0e-85fb-ab5f8024b35e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:26.610666 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-f7a3b64e-3074-4a0e-85fb-ab5f8024b35e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 13f1df4b-056e-4637-a0ec-54f6f78c8730] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:26.618496 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f7a3b64e-3074-4a0e-85fb-ab5f8024b35e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:26.626839 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f7a3b64e-3074-4a0e-85fb-ab5f8024b35e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:26.626839 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f7a3b64e-3074-4a0e-85fb-ab5f8024b35e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:26.626839 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f7a3b64e-3074-4a0e-85fb-ab5f8024b35e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:26.626839 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f7a3b64e-3074-4a0e-85fb-ab5f8024b35e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:26.627357 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f7a3b64e-3074-4a0e-85fb-ab5f8024b35e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:26.810624 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-f7a3b64e-3074-4a0e-85fb-ab5f8024b35e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:26.821706 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-f7a3b64e-3074-4a0e-85fb-ab5f8024b35e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730" status: 200 len: 1521 microversion: 2.1 time: 0.221625 Aug 24 03:54:26.826592 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 147/294] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:26 2022] GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:27.512242 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-02d23b01-d232-41c2-83a5-95b348b2b47a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:27.512851 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-02d23b01-d232-41c2-83a5-95b348b2b47a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:27.519831 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-02d23b01-d232-41c2-83a5-95b348b2b47a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:27.520320 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-02d23b01-d232-41c2-83a5-95b348b2b47a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:27.520869 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-02d23b01-d232-41c2-83a5-95b348b2b47a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:27.521446 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-02d23b01-d232-41c2-83a5-95b348b2b47a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:27.521986 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-02d23b01-d232-41c2-83a5-95b348b2b47a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:27.522301 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-02d23b01-d232-41c2-83a5-95b348b2b47a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:27.782257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-02d23b01-d232-41c2-83a5-95b348b2b47a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:27.793637 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-02d23b01-d232-41c2-83a5-95b348b2b47a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:27.795389 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-02d23b01-d232-41c2-83a5-95b348b2b47a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:27.796856 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-02d23b01-d232-41c2-83a5-95b348b2b47a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1724 microversion: 2.20 time: 0.288345 Aug 24 03:54:27.797578 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 148/295] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:27 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1724 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:54:27.849550 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-16c09b65-bd24-49cc-a0d6-a65fdde466e8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:27.850185 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-16c09b65-bd24-49cc-a0d6-a65fdde466e8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 13f1df4b-056e-4637-a0ec-54f6f78c8730] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:27.858363 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-16c09b65-bd24-49cc-a0d6-a65fdde466e8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:27.858960 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-16c09b65-bd24-49cc-a0d6-a65fdde466e8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:27.859782 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-16c09b65-bd24-49cc-a0d6-a65fdde466e8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:27.860558 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-16c09b65-bd24-49cc-a0d6-a65fdde466e8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:27.861098 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-16c09b65-bd24-49cc-a0d6-a65fdde466e8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:27.861592 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-16c09b65-bd24-49cc-a0d6-a65fdde466e8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:28.036877 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-16c09b65-bd24-49cc-a0d6-a65fdde466e8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:28.045535 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-16c09b65-bd24-49cc-a0d6-a65fdde466e8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730" status: 200 len: 1521 microversion: 2.1 time: 0.200188 Aug 24 03:54:28.046396 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 148/296] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:27 2022] GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:28.822096 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-128599f3-9219-4925-8cb6-68bfeab1b3ec tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:28.822815 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-128599f3-9219-4925-8cb6-68bfeab1b3ec tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:28.830018 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-128599f3-9219-4925-8cb6-68bfeab1b3ec tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:28.830531 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-128599f3-9219-4925-8cb6-68bfeab1b3ec tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:28.832554 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-128599f3-9219-4925-8cb6-68bfeab1b3ec tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:28.833294 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-128599f3-9219-4925-8cb6-68bfeab1b3ec tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:28.833761 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-128599f3-9219-4925-8cb6-68bfeab1b3ec tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:28.834190 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-128599f3-9219-4925-8cb6-68bfeab1b3ec tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:29.003141 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-128599f3-9219-4925-8cb6-68bfeab1b3ec tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:29.011516 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-128599f3-9219-4925-8cb6-68bfeab1b3ec tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:29.013290 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-128599f3-9219-4925-8cb6-68bfeab1b3ec tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:29.015219 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-128599f3-9219-4925-8cb6-68bfeab1b3ec tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1724 microversion: 2.20 time: 0.196949 Aug 24 03:54:29.019402 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 149/297] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:28 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:54:29.069191 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-101295b1-97cd-40fa-b687-275234fb764b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:29.069824 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-101295b1-97cd-40fa-b687-275234fb764b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 13f1df4b-056e-4637-a0ec-54f6f78c8730] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:29.076714 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-101295b1-97cd-40fa-b687-275234fb764b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:29.077202 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-101295b1-97cd-40fa-b687-275234fb764b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:29.077635 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-101295b1-97cd-40fa-b687-275234fb764b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:29.078329 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-101295b1-97cd-40fa-b687-275234fb764b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:29.078807 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-101295b1-97cd-40fa-b687-275234fb764b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:29.079227 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-101295b1-97cd-40fa-b687-275234fb764b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:29.098187 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:29.217139 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-101295b1-97cd-40fa-b687-275234fb764b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:29.225796 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-101295b1-97cd-40fa-b687-275234fb764b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730" status: 200 len: 1521 microversion: 2.1 time: 0.160448 Aug 24 03:54:29.226462 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 149/298] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:29 2022] GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:30.039108 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-43eeb29e-255f-4275-9a41-aa0393670931 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:30.040358 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-43eeb29e-255f-4275-9a41-aa0393670931 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:30.064627 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-43eeb29e-255f-4275-9a41-aa0393670931 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:30.065219 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-43eeb29e-255f-4275-9a41-aa0393670931 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:30.068583 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-43eeb29e-255f-4275-9a41-aa0393670931 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:30.070166 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-43eeb29e-255f-4275-9a41-aa0393670931 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:30.070670 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-43eeb29e-255f-4275-9a41-aa0393670931 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:30.073552 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-43eeb29e-255f-4275-9a41-aa0393670931 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:30.247183 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-85abf6e0-97b3-4435-8cba-127f7a652a73 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:30.248345 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-85abf6e0-97b3-4435-8cba-127f7a652a73 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 13f1df4b-056e-4637-a0ec-54f6f78c8730] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:30.259033 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-85abf6e0-97b3-4435-8cba-127f7a652a73 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:30.259440 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-85abf6e0-97b3-4435-8cba-127f7a652a73 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:30.262871 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-85abf6e0-97b3-4435-8cba-127f7a652a73 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:30.270701 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-85abf6e0-97b3-4435-8cba-127f7a652a73 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:30.270701 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-85abf6e0-97b3-4435-8cba-127f7a652a73 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:30.270701 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-85abf6e0-97b3-4435-8cba-127f7a652a73 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:30.386785 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-43eeb29e-255f-4275-9a41-aa0393670931 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:30.402922 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-43eeb29e-255f-4275-9a41-aa0393670931 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:30.411399 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-43eeb29e-255f-4275-9a41-aa0393670931 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:30.411399 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-43eeb29e-255f-4275-9a41-aa0393670931 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1724 microversion: 2.20 time: 0.374017 Aug 24 03:54:30.411399 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 150/299] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:30 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1724 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:54:30.469840 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-85abf6e0-97b3-4435-8cba-127f7a652a73 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:30.484169 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-85abf6e0-97b3-4435-8cba-127f7a652a73 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730" status: 200 len: 1521 microversion: 2.1 time: 0.240065 Aug 24 03:54:30.485816 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 150/300] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:30 2022] GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:31.436347 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d468c1ad-aec4-4eab-8f0b-945e33348cb2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:31.437937 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d468c1ad-aec4-4eab-8f0b-945e33348cb2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:31.451466 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d468c1ad-aec4-4eab-8f0b-945e33348cb2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:31.455341 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d468c1ad-aec4-4eab-8f0b-945e33348cb2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:31.455847 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d468c1ad-aec4-4eab-8f0b-945e33348cb2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:31.458592 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d468c1ad-aec4-4eab-8f0b-945e33348cb2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:31.461507 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d468c1ad-aec4-4eab-8f0b-945e33348cb2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:31.467600 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d468c1ad-aec4-4eab-8f0b-945e33348cb2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:31.505485 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-2e6eedce-bb33-45af-9f60-031d96b93556 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:31.506822 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-2e6eedce-bb33-45af-9f60-031d96b93556 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 13f1df4b-056e-4637-a0ec-54f6f78c8730] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:31.522304 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2e6eedce-bb33-45af-9f60-031d96b93556 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:31.528800 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2e6eedce-bb33-45af-9f60-031d96b93556 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:31.528800 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2e6eedce-bb33-45af-9f60-031d96b93556 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:31.528800 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2e6eedce-bb33-45af-9f60-031d96b93556 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:31.531764 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2e6eedce-bb33-45af-9f60-031d96b93556 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:31.535636 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2e6eedce-bb33-45af-9f60-031d96b93556 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:31.692005 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-d468c1ad-aec4-4eab-8f0b-945e33348cb2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:31.713530 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-d468c1ad-aec4-4eab-8f0b-945e33348cb2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:31.716196 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-d468c1ad-aec4-4eab-8f0b-945e33348cb2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:31.719511 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d468c1ad-aec4-4eab-8f0b-945e33348cb2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1745 microversion: 2.20 time: 0.290017 Aug 24 03:54:31.722964 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 151/301] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:31 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1745 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:54:31.806941 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-2e6eedce-bb33-45af-9f60-031d96b93556 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:31.825772 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-2e6eedce-bb33-45af-9f60-031d96b93556 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730" status: 200 len: 1521 microversion: 2.1 time: 0.324148 Aug 24 03:54:31.827627 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 151/302] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:31 2022] GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730 => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:32.745433 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-48ece825-b115-49b5-80fb-7912a1c8a913 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:32.746326 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-48ece825-b115-49b5-80fb-7912a1c8a913 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:32.757963 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48ece825-b115-49b5-80fb-7912a1c8a913 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:32.758451 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48ece825-b115-49b5-80fb-7912a1c8a913 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:32.758923 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48ece825-b115-49b5-80fb-7912a1c8a913 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:32.762762 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48ece825-b115-49b5-80fb-7912a1c8a913 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:32.763690 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48ece825-b115-49b5-80fb-7912a1c8a913 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:32.764115 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48ece825-b115-49b5-80fb-7912a1c8a913 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:32.851969 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-1b269469-2bc0-4873-973b-b14d77cf95c9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:32.852577 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-1b269469-2bc0-4873-973b-b14d77cf95c9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 13f1df4b-056e-4637-a0ec-54f6f78c8730] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:32.866866 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1b269469-2bc0-4873-973b-b14d77cf95c9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:32.867655 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1b269469-2bc0-4873-973b-b14d77cf95c9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:32.870531 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1b269469-2bc0-4873-973b-b14d77cf95c9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:32.871447 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1b269469-2bc0-4873-973b-b14d77cf95c9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:32.871910 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1b269469-2bc0-4873-973b-b14d77cf95c9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:32.872340 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1b269469-2bc0-4873-973b-b14d77cf95c9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:32.951454 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-48ece825-b115-49b5-80fb-7912a1c8a913 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:32.965784 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-48ece825-b115-49b5-80fb-7912a1c8a913 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:32.973184 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-48ece825-b115-49b5-80fb-7912a1c8a913 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:32.973184 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-48ece825-b115-49b5-80fb-7912a1c8a913 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1745 microversion: 2.20 time: 0.227048 Aug 24 03:54:32.973184 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 152/303] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:32 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1745 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:54:33.061767 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-1b269469-2bc0-4873-973b-b14d77cf95c9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:33.079395 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-1b269469-2bc0-4873-973b-b14d77cf95c9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730" status: 200 len: 1501 microversion: 2.1 time: 0.232542 Aug 24 03:54:33.080251 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 152/304] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:32 2022] GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730 => generated 1501 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:33.117201 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-638e54d4-699d-48e6-8c18-f4bca654664a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f5af524-6949-47c4-bd13-575da85dda3d"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:33.119680 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-638e54d4-699d-48e6-8c18-f4bca654664a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 13f1df4b-056e-4637-a0ec-54f6f78c8730] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:33.126192 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-638e54d4-699d-48e6-8c18-f4bca654664a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:33.126955 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-638e54d4-699d-48e6-8c18-f4bca654664a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:33.127608 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-638e54d4-699d-48e6-8c18-f4bca654664a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:33.128507 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-638e54d4-699d-48e6-8c18-f4bca654664a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:33.129244 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-638e54d4-699d-48e6-8c18-f4bca654664a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:33.129872 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-638e54d4-699d-48e6-8c18-f4bca654664a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:33.156975 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-638e54d4-699d-48e6-8c18-f4bca654664a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] HTTP exception thrown: Cannot 'attach_volume' instance 13f1df4b-056e-4637-a0ec-54f6f78c8730 while it is in vm_state rescued Aug 24 03:54:33.158786 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-638e54d4-699d-48e6-8c18-f4bca654664a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Request method failure captured: Aug 24 03:54:33.158786 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: request: POST /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730/os-volume_attachments HTTP/1.1 Aug 24 03:54:33.158786 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept: application/json Aug 24 03:54:33.158786 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept-Encoding: identity Aug 24 03:54:33.158786 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Connection: close Aug 24 03:54:33.158786 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Length: 74 Aug 24 03:54:33.158786 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Type: application/json Aug 24 03:54:33.158786 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Host: 10.222.0.82 Aug 24 03:54:33.158786 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Openstack-System-Scope: None Aug 24 03:54:33.158786 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.11 Aug 24 03:54:33.158786 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Auth-Token: gAAAAABjBaBwfFwtOW_HqduVs-Y72_nB0AfAGPkKiTC3c4uSLXKyBQUeIsdjnKcKqOXOXGzaPm3531c8BOjXNm1ZmlI5tsEEAgDjb8e71EXHI4eXRLl99FfDJSPPx9GmrFEVoPYMPEhZvpFFVWFOIsIGclHl28xUAF2supcEcrqrvkfNAW9RaN4 Aug 24 03:54:33.158786 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Id: None Aug 24 03:54:33.158786 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Name: None Aug 24 03:54:33.158786 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Identity-Status: Confirmed Aug 24 03:54:33.158786 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Is-Admin-Project: True Aug 24 03:54:33.158786 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Id: default Aug 24 03:54:33.158786 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Name: Default Aug 24 03:54:33.158786 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Id: 63408551e1b24a86b8f0059f1a948896 Aug 24 03:54:33.158786 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-496383813 Aug 24 03:54:33.158786 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Role: member,reader Aug 24 03:54:33.158786 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Roles: member,reader Aug 24 03:54:33.166925 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/63408551e1b24a86b8f0059f1a948896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/63408551e1b24a86b8f0059f1a948896"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/63408551e1b24a86b8f0059f1a948896"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_63408551e1b24a86b8f0059f1a948896", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:54:33.166925 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant: tempest-ServerRescueNegativeTestJSON-496383813 Aug 24 03:54:33.166925 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Id: 63408551e1b24a86b8f0059f1a948896 Aug 24 03:54:33.166925 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-496383813 Aug 24 03:54:33.166925 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User: tempest-ServerRescueNegativeTestJSON-496383813-project Aug 24 03:54:33.166925 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Id: default Aug 24 03:54:33.166925 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Name: Default Aug 24 03:54:33.166925 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Id: 547bce0d8133462c95bcb6f272776a27 Aug 24 03:54:33.166925 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Name: tempest-ServerRescueNegativeTestJSON-496383813-project Aug 24 03:54:33.166925 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Aug 24 03:54:33.166925 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: {"volumeAttachment": {"volumeId": "3f5af524-6949-47c4-bd13-575da85dda3d"}} Aug 24 03:54:33.166925 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: method: > Aug 24 03:54:33.167682 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: exception: Cannot 'attach_volume' instance 13f1df4b-056e-4637-a0ec-54f6f78c8730 while it is in vm_state rescued Aug 24 03:54:33.167682 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: action_args: {'server_id': '13f1df4b-056e-4637-a0ec-54f6f78c8730', 'body': {'volumeAttachment': {'volumeId': '3f5af524-6949-47c4-bd13-575da85dda3d'}}} Aug 24 03:54:33.167682 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:54:33.167682 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:33.167682 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 03:54:33.167682 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 03:54:33.167682 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 03:54:33.167682 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 03:54:33.167682 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 03:54:33.167682 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 03:54:33.167682 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 13f1df4b-056e-4637-a0ec-54f6f78c8730 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 03:54:33.167682 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:54:33.167682 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:33.167682 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:54:33.167682 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:33.167682 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:33.167682 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:33.167682 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:54:33.167682 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:54:33.168931 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:54:33.168931 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:54:33.168931 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:54:33.168931 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:54:33.168931 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:54:33.168931 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:54:33.168931 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:54:33.168931 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:54:33.168931 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 03:54:33.168931 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 03:54:33.168931 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 03:54:33.168931 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 03:54:33.168931 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 13f1df4b-056e-4637-a0ec-54f6f78c8730 while it is in vm_state rescued Aug 24 03:54:33.168931 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:54:33.168931 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:33.168931 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:54:33.168931 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:33.168931 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:33.168931 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:33.169996 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:54:33.169996 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:54:33.169996 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 13f1df4b-056e-4637-a0ec-54f6f78c8730 while it is in vm_state rescued Aug 24 03:54:33.169996 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:54:33.169996 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-638e54d4-699d-48e6-8c18-f4bca654664a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Returning 409 to user: Cannot 'attach_volume' instance 13f1df4b-056e-4637-a0ec-54f6f78c8730 while it is in vm_state rescued {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:54:33.169996 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-638e54d4-699d-48e6-8c18-f4bca654664a tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "POST /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.048872 Aug 24 03:54:33.169996 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 153/305] 10.222.0.82 () {60 vars in 1323 bytes} [Wed Aug 24 03:54:33 2022] POST /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730/os-volume_attachments => generated 152 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:54:33.176161 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-d4cf9f51-57ed-4e60-93a3-5bffa286ef86 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:33.176697 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-d4cf9f51-57ed-4e60-93a3-5bffa286ef86 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 13f1df4b-056e-4637-a0ec-54f6f78c8730] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:33.203081 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d4cf9f51-57ed-4e60-93a3-5bffa286ef86 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:33.203667 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d4cf9f51-57ed-4e60-93a3-5bffa286ef86 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:33.204003 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d4cf9f51-57ed-4e60-93a3-5bffa286ef86 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:33.204745 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d4cf9f51-57ed-4e60-93a3-5bffa286ef86 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:33.205196 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d4cf9f51-57ed-4e60-93a3-5bffa286ef86 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:33.205618 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d4cf9f51-57ed-4e60-93a3-5bffa286ef86 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:33.995085 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-959221f3-3b43-463f-b445-def109d6c2dd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:33.995831 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-959221f3-3b43-463f-b445-def109d6c2dd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:34.002318 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-959221f3-3b43-463f-b445-def109d6c2dd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:34.002991 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-959221f3-3b43-463f-b445-def109d6c2dd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:34.003435 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-959221f3-3b43-463f-b445-def109d6c2dd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:34.004136 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-959221f3-3b43-463f-b445-def109d6c2dd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:34.004592 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-959221f3-3b43-463f-b445-def109d6c2dd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:34.005014 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-959221f3-3b43-463f-b445-def109d6c2dd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:34.038841 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-d4cf9f51-57ed-4e60-93a3-5bffa286ef86 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "POST /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730/action" status: 202 len: 0 microversion: 2.1 time: 0.866611 Aug 24 03:54:34.042378 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 153/306] 10.222.0.82 () {60 vars in 1278 bytes} [Wed Aug 24 03:54:33 2022] POST /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730/action => generated 0 bytes in 868 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:54:34.047617 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-39267b20-37a6-44c0-bb34-dc19b9165a35 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:34.048360 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-39267b20-37a6-44c0-bb34-dc19b9165a35 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 13f1df4b-056e-4637-a0ec-54f6f78c8730] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:34.055945 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-39267b20-37a6-44c0-bb34-dc19b9165a35 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:34.056421 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-39267b20-37a6-44c0-bb34-dc19b9165a35 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:34.056848 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-39267b20-37a6-44c0-bb34-dc19b9165a35 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:34.057529 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-39267b20-37a6-44c0-bb34-dc19b9165a35 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:34.057974 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-39267b20-37a6-44c0-bb34-dc19b9165a35 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:34.058381 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-39267b20-37a6-44c0-bb34-dc19b9165a35 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:34.162627 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-959221f3-3b43-463f-b445-def109d6c2dd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:34.178290 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-959221f3-3b43-463f-b445-def109d6c2dd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:34.180165 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-959221f3-3b43-463f-b445-def109d6c2dd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:34.181939 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-959221f3-3b43-463f-b445-def109d6c2dd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1745 microversion: 2.20 time: 0.191785 Aug 24 03:54:34.182945 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 154/307] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:33 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1745 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:54:34.233340 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-39267b20-37a6-44c0-bb34-dc19b9165a35 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:34.242128 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-39267b20-37a6-44c0-bb34-dc19b9165a35 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730" status: 200 len: 1509 microversion: 2.1 time: 0.198280 Aug 24 03:54:34.243872 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 154/308] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:34 2022] GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730 => generated 1509 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:35.150974 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5a9138a2-82ad-4ac9-85b1-251e08b50340 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Action: 'create', calling method: .version_select at 0x7f1556aba790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1388918039", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGzI1tcWG+HIcpGfUE6mrFtiwKJ/lcyVKPt25m25aSexn6K4dXB1/wP1zFgJ10JymOOU7jmjD7021QRNJirxZCD0LMsabBi895DqtJmRjpQ1QX9GnZSeLjeEAJoZR8LPQ=="}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:35.167553 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.quota [None req-5a9138a2-82ad-4ac9-85b1-251e08b50340 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Getting quotas for project 5d84c2db19c24ef49d5012dd6c28cb7b. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:54:35.171435 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.quota [None req-5a9138a2-82ad-4ac9-85b1-251e08b50340 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Getting quotas for user c662a5d21958400daa83733a93ca4c11 and project 5d84c2db19c24ef49d5012dd6c28cb7b. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:54:35.214594 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-47823475-ca0b-45bc-a02a-dd28ab50383d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:35.215198 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-47823475-ca0b-45bc-a02a-dd28ab50383d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:35.217557 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:35.222620 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-47823475-ca0b-45bc-a02a-dd28ab50383d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:35.223109 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-47823475-ca0b-45bc-a02a-dd28ab50383d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:35.223543 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-47823475-ca0b-45bc-a02a-dd28ab50383d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:35.224698 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-47823475-ca0b-45bc-a02a-dd28ab50383d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:35.224797 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-47823475-ca0b-45bc-a02a-dd28ab50383d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:35.225197 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-47823475-ca0b-45bc-a02a-dd28ab50383d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:35.246974 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5a9138a2-82ad-4ac9-85b1-251e08b50340 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.099803 Aug 24 03:54:35.247583 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 155/309] 10.222.0.82 () {60 vars in 1159 bytes} [Wed Aug 24 03:54:35 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:54:35.266211 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-262dbc20-25f4-4f59-b092-377c44b9f411 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:35.266854 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-262dbc20-25f4-4f59-b092-377c44b9f411 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 13f1df4b-056e-4637-a0ec-54f6f78c8730] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:35.274165 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-262dbc20-25f4-4f59-b092-377c44b9f411 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:35.274689 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-262dbc20-25f4-4f59-b092-377c44b9f411 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:35.275131 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-262dbc20-25f4-4f59-b092-377c44b9f411 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:35.275827 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-262dbc20-25f4-4f59-b092-377c44b9f411 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:35.276398 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-262dbc20-25f4-4f59-b092-377c44b9f411 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:35.276824 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-262dbc20-25f4-4f59-b092-377c44b9f411 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:35.382433 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-47823475-ca0b-45bc-a02a-dd28ab50383d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:35.388421 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-47823475-ca0b-45bc-a02a-dd28ab50383d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:35.390012 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-47823475-ca0b-45bc-a02a-dd28ab50383d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:35.391359 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-47823475-ca0b-45bc-a02a-dd28ab50383d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1745 microversion: 2.20 time: 0.180632 Aug 24 03:54:35.402872 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 155/310] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:35 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1745 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:54:35.413013 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-c278a4c1-7de7-43fb-9568-52124a5a853a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-258054962", "imageRef": "a6c36965-1072-434f-be5e-1d2c045d783d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1388918039", "networks": [{"uuid": "b58c2b84-e3f6-407d-b434-32ce63bcb09f"}]}} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:35.437235 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-262dbc20-25f4-4f59-b092-377c44b9f411 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:35.441612 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:35.447021 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-262dbc20-25f4-4f59-b092-377c44b9f411 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730" status: 200 len: 1509 microversion: 2.1 time: 0.184466 Aug 24 03:54:35.447459 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 156/311] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:35 2022] GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730 => generated 1509 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:35.468746 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.network.neutron [None req-c278a4c1-7de7-43fb-9568-52124a5a853a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] validate_networks() for [('b58c2b84-e3f6-407d-b434-32ce63bcb09f', None, None, None, None, None)] {{(pid=127869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:54:36.055567 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-c278a4c1-7de7-43fb-9568-52124a5a853a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Flavor limits 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:54:36.055987 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-c278a4c1-7de7-43fb-9568-52124a5a853a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Image limits 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:54:36.056458 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-c278a4c1-7de7-43fb-9568-52124a5a853a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Flavor pref 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:54:36.056891 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-c278a4c1-7de7-43fb-9568-52124a5a853a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Image pref 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:54:36.057300 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-c278a4c1-7de7-43fb-9568-52124a5a853a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:54:36.067140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c278a4c1-7de7-43fb-9568-52124a5a853a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:36.067675 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c278a4c1-7de7-43fb-9568-52124a5a853a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:36.074197 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c278a4c1-7de7-43fb-9568-52124a5a853a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:36.074197 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c278a4c1-7de7-43fb-9568-52124a5a853a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:36.074197 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c278a4c1-7de7-43fb-9568-52124a5a853a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:36.074197 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c278a4c1-7de7-43fb-9568-52124a5a853a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:36.092292 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.quota [None req-c278a4c1-7de7-43fb-9568-52124a5a853a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Getting quotas for project 5d84c2db19c24ef49d5012dd6c28cb7b. Resources: {'instances', 'cores', 'ram'} {{(pid=127869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:54:36.096841 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.quota [None req-c278a4c1-7de7-43fb-9568-52124a5a853a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Getting quotas for user c662a5d21958400daa83733a93ca4c11 and project 5d84c2db19c24ef49d5012dd6c28cb7b. Resources: {'instances', 'cores', 'ram'} {{(pid=127869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:54:36.108070 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-c278a4c1-7de7-43fb-9568-52124a5a853a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Going to run 1 instances... {{(pid=127869) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:54:36.110222 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-c278a4c1-7de7-43fb-9568-52124a5a853a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6c36965-1072-434f-be5e-1d2c045d783d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:54:36.276669 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-b84dcb8b-051b-4b04-92b0-4a1567fc0377 req-48e04ceb-67ba-402e-8396-2d73f861d761 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8b22210-7e08-4f01-bf00-d84b0e5e34d7", "name": "network-vif-plugged", "status": "completed", "tag": "a6ef21fe-e9ce-414a-a115-1f2f2babf6fc"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:36.278156 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-c278a4c1-7de7-43fb-9568-52124a5a853a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.873996 Aug 24 03:54:36.285485 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 156/312] 10.222.0.82 () {60 vars in 1147 bytes} [Wed Aug 24 03:54:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:54:36.290429 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-338e7965-bcd8-447a-bd57-790766a90696 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:36.291057 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-338e7965-bcd8-447a-bd57-790766a90696 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:36.292743 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-b84dcb8b-051b-4b04-92b0-4a1567fc0377 req-48e04ceb-67ba-402e-8396-2d73f861d761 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:36.293443 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-b84dcb8b-051b-4b04-92b0-4a1567fc0377 req-48e04ceb-67ba-402e-8396-2d73f861d761 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:36.294155 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-b84dcb8b-051b-4b04-92b0-4a1567fc0377 req-48e04ceb-67ba-402e-8396-2d73f861d761 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:36.310901 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-b84dcb8b-051b-4b04-92b0-4a1567fc0377 req-48e04ceb-67ba-402e-8396-2d73f861d761 service nova] Creating event network-vif-plugged:a6ef21fe-e9ce-414a-a115-1f2f2babf6fc for instance b8b22210-7e08-4f01-bf00-d84b0e5e34d7 on hv-cinder-85426 Aug 24 03:54:36.316860 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-b84dcb8b-051b-4b04-92b0-4a1567fc0377 req-48e04ceb-67ba-402e-8396-2d73f861d761 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045745 Aug 24 03:54:36.317917 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 157/313] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:54:36.358233 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-338e7965-bcd8-447a-bd57-790766a90696 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:36.365608 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-338e7965-bcd8-447a-bd57-790766a90696 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1258 microversion: 2.1 time: 0.079029 Aug 24 03:54:36.367072 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 157/314] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:36 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1258 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:36.423232 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1bb789fa-3920-4559-a843-76be57cb22fb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:36.424107 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1bb789fa-3920-4559-a843-76be57cb22fb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:36.431592 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1bb789fa-3920-4559-a843-76be57cb22fb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:36.432083 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1bb789fa-3920-4559-a843-76be57cb22fb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:36.432520 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1bb789fa-3920-4559-a843-76be57cb22fb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:36.433245 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1bb789fa-3920-4559-a843-76be57cb22fb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:36.433704 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1bb789fa-3920-4559-a843-76be57cb22fb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:36.434127 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1bb789fa-3920-4559-a843-76be57cb22fb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:36.482200 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-49d833cb-72f4-4244-b776-de841f77f1a8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:36.483089 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-49d833cb-72f4-4244-b776-de841f77f1a8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 13f1df4b-056e-4637-a0ec-54f6f78c8730] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:36.495207 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-49d833cb-72f4-4244-b776-de841f77f1a8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:36.495793 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-49d833cb-72f4-4244-b776-de841f77f1a8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:36.496782 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-49d833cb-72f4-4244-b776-de841f77f1a8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:36.497576 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-49d833cb-72f4-4244-b776-de841f77f1a8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:36.498114 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-49d833cb-72f4-4244-b776-de841f77f1a8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:36.501034 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-49d833cb-72f4-4244-b776-de841f77f1a8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:36.671958 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-49d833cb-72f4-4244-b776-de841f77f1a8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:36.680523 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-49d833cb-72f4-4244-b776-de841f77f1a8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730" status: 200 len: 1509 microversion: 2.1 time: 0.202717 Aug 24 03:54:36.681098 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 158/315] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:36 2022] GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730 => generated 1509 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:36.731120 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-1bb789fa-3920-4559-a843-76be57cb22fb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:36.740324 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-1bb789fa-3920-4559-a843-76be57cb22fb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:36.741912 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-1bb789fa-3920-4559-a843-76be57cb22fb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:36.745975 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1bb789fa-3920-4559-a843-76be57cb22fb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1745 microversion: 2.20 time: 0.328172 Aug 24 03:54:36.745975 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 158/316] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:36 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1745 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:54:37.388235 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-174bc9b5-8610-4ab5-b27b-d10a37829309 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:37.388847 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-174bc9b5-8610-4ab5-b27b-d10a37829309 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:37.445787 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-174bc9b5-8610-4ab5-b27b-d10a37829309 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:37.453869 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-174bc9b5-8610-4ab5-b27b-d10a37829309 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1258 microversion: 2.1 time: 0.070049 Aug 24 03:54:37.454613 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 159/317] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:37 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:37.712497 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f4a1e733-8dc3-44ef-ad4f-599ebf15d7a5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:37.713395 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f4a1e733-8dc3-44ef-ad4f-599ebf15d7a5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 13f1df4b-056e-4637-a0ec-54f6f78c8730] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:37.720527 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f4a1e733-8dc3-44ef-ad4f-599ebf15d7a5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:37.721048 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f4a1e733-8dc3-44ef-ad4f-599ebf15d7a5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:37.721484 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f4a1e733-8dc3-44ef-ad4f-599ebf15d7a5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:37.722227 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f4a1e733-8dc3-44ef-ad4f-599ebf15d7a5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:37.722738 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f4a1e733-8dc3-44ef-ad4f-599ebf15d7a5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:37.723357 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f4a1e733-8dc3-44ef-ad4f-599ebf15d7a5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:37.771024 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-c9542d96-da50-4ec6-a6b6-42e8a73da0b5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:37.772436 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-c9542d96-da50-4ec6-a6b6-42e8a73da0b5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:37.781954 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c9542d96-da50-4ec6-a6b6-42e8a73da0b5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:37.782837 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c9542d96-da50-4ec6-a6b6-42e8a73da0b5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:37.783685 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c9542d96-da50-4ec6-a6b6-42e8a73da0b5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:37.784684 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c9542d96-da50-4ec6-a6b6-42e8a73da0b5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:37.785356 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c9542d96-da50-4ec6-a6b6-42e8a73da0b5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:37.786000 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c9542d96-da50-4ec6-a6b6-42e8a73da0b5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:37.879879 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-f4a1e733-8dc3-44ef-ad4f-599ebf15d7a5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:37.888416 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f4a1e733-8dc3-44ef-ad4f-599ebf15d7a5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730" status: 200 len: 1509 microversion: 2.1 time: 0.189296 Aug 24 03:54:37.889029 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 159/318] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:37 2022] GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730 => generated 1509 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:37.928964 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-c9542d96-da50-4ec6-a6b6-42e8a73da0b5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:37.937748 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-c9542d96-da50-4ec6-a6b6-42e8a73da0b5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:37.939279 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-c9542d96-da50-4ec6-a6b6-42e8a73da0b5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:37.941088 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-c9542d96-da50-4ec6-a6b6-42e8a73da0b5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1740 microversion: 2.20 time: 0.175614 Aug 24 03:54:37.941753 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 160/319] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:37 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:54:38.483704 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8df0a5d7-8f0d-46dc-84b7-cd83e09e766a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:38.483704 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8df0a5d7-8f0d-46dc-84b7-cd83e09e766a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:38.490571 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8df0a5d7-8f0d-46dc-84b7-cd83e09e766a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:38.491443 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8df0a5d7-8f0d-46dc-84b7-cd83e09e766a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:38.492352 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8df0a5d7-8f0d-46dc-84b7-cd83e09e766a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:38.493544 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8df0a5d7-8f0d-46dc-84b7-cd83e09e766a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:38.494418 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8df0a5d7-8f0d-46dc-84b7-cd83e09e766a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:38.495212 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8df0a5d7-8f0d-46dc-84b7-cd83e09e766a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:38.566928 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-8df0a5d7-8f0d-46dc-84b7-cd83e09e766a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:38.585840 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8df0a5d7-8f0d-46dc-84b7-cd83e09e766a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1262 microversion: 2.1 time: 0.113294 Aug 24 03:54:38.602313 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 160/320] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:38 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1262 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:38.794986 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-ce756244-f0b4-475a-8957-5d5058684dcc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Action: 'create', calling method: .version_select at 0x7f155448b9d0>, body: {"keypair": {"name": "tempest-keypair-1852283799", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGKCyWC+GeYa4wezOalGEaN+Ms4ln9itvy+LFdHL9X96Apj/QvazPmE+uXhOHBlrNUO0YflBcR2Iw3j3xwsC0T9NZ9Qw+IlYVAiAHKUoYZcZzEVC+ZUb4zEDY4jB06aeg=="}} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:38.822660 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.quota [None req-ce756244-f0b4-475a-8957-5d5058684dcc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Getting quotas for project 46ef5b02d8da4d2eac26b6ccfb35e1a4. Resources: {'key_pairs'} {{(pid=127869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:54:38.833767 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.quota [None req-ce756244-f0b4-475a-8957-5d5058684dcc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Getting quotas for user e5582d10ebef459084fe287c18568f98 and project 46ef5b02d8da4d2eac26b6ccfb35e1a4. Resources: {'key_pairs'} {{(pid=127869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:54:38.926294 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-428ae8e7-7d8c-42c8-96a0-e68e71a600f6 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:38.926294 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-428ae8e7-7d8c-42c8-96a0-e68e71a600f6 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 13f1df4b-056e-4637-a0ec-54f6f78c8730] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:38.928982 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-428ae8e7-7d8c-42c8-96a0-e68e71a600f6 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:38.929405 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-428ae8e7-7d8c-42c8-96a0-e68e71a600f6 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:38.930288 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-428ae8e7-7d8c-42c8-96a0-e68e71a600f6 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:38.931206 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-428ae8e7-7d8c-42c8-96a0-e68e71a600f6 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:38.931657 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-428ae8e7-7d8c-42c8-96a0-e68e71a600f6 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:38.932075 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-428ae8e7-7d8c-42c8-96a0-e68e71a600f6 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:39.071105 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-ce756244-f0b4-475a-8957-5d5058684dcc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.282925 Aug 24 03:54:39.071922 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 161/321] 10.222.0.82 () {60 vars in 1159 bytes} [Wed Aug 24 03:54:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:54:39.085746 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-37e407f5-d4d8-47a4-add0-9b42247d5533 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:39.092223 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-37e407f5-d4d8-47a4-add0-9b42247d5533 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:39.106690 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-428ae8e7-7d8c-42c8-96a0-e68e71a600f6 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:39.114092 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-37e407f5-d4d8-47a4-add0-9b42247d5533 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:39.114631 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-37e407f5-d4d8-47a4-add0-9b42247d5533 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:39.115167 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-37e407f5-d4d8-47a4-add0-9b42247d5533 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:39.116459 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-37e407f5-d4d8-47a4-add0-9b42247d5533 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:39.117078 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-37e407f5-d4d8-47a4-add0-9b42247d5533 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:39.117660 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-37e407f5-d4d8-47a4-add0-9b42247d5533 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:39.120008 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-428ae8e7-7d8c-42c8-96a0-e68e71a600f6 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730" status: 200 len: 1509 microversion: 2.1 time: 0.209072 Aug 24 03:54:39.124506 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 161/322] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:38 2022] GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730 => generated 1509 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:39.307627 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-37e407f5-d4d8-47a4-add0-9b42247d5533 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:39.318833 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-37e407f5-d4d8-47a4-add0-9b42247d5533 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:39.321134 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-37e407f5-d4d8-47a4-add0-9b42247d5533 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:39.322411 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-37e407f5-d4d8-47a4-add0-9b42247d5533 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1740 microversion: 2.20 time: 0.242721 Aug 24 03:54:39.323022 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 162/323] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:39 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1740 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:54:39.617474 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1775f6ba-2a0e-4d41-b56b-efd09372d09f tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:39.618493 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1775f6ba-2a0e-4d41-b56b-efd09372d09f tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:39.626082 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1775f6ba-2a0e-4d41-b56b-efd09372d09f tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:39.627725 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1775f6ba-2a0e-4d41-b56b-efd09372d09f tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:39.629686 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1775f6ba-2a0e-4d41-b56b-efd09372d09f tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:39.632209 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1775f6ba-2a0e-4d41-b56b-efd09372d09f tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:39.633156 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1775f6ba-2a0e-4d41-b56b-efd09372d09f tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:39.633817 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1775f6ba-2a0e-4d41-b56b-efd09372d09f tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:39.794741 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-1775f6ba-2a0e-4d41-b56b-efd09372d09f tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:39.804195 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1775f6ba-2a0e-4d41-b56b-efd09372d09f tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1262 microversion: 2.1 time: 0.192309 Aug 24 03:54:39.805411 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 162/324] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:39 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1262 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:40.150344 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-cae57f03-6671-4cac-992f-002827e63998 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:40.151121 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-cae57f03-6671-4cac-992f-002827e63998 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 13f1df4b-056e-4637-a0ec-54f6f78c8730] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:40.157637 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cae57f03-6671-4cac-992f-002827e63998 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:40.158308 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cae57f03-6671-4cac-992f-002827e63998 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:40.158864 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cae57f03-6671-4cac-992f-002827e63998 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:40.159996 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cae57f03-6671-4cac-992f-002827e63998 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:40.160549 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cae57f03-6671-4cac-992f-002827e63998 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:40.161355 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cae57f03-6671-4cac-992f-002827e63998 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:40.338014 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-cae57f03-6671-4cac-992f-002827e63998 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:40.349070 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cf58fd7c-e363-466a-8de2-f2ec03aa6f40 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:40.349878 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cf58fd7c-e363-466a-8de2-f2ec03aa6f40 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:40.352380 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:40.360143 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-cae57f03-6671-4cac-992f-002827e63998 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730" status: 200 len: 1509 microversion: 2.1 time: 0.213805 Aug 24 03:54:40.364457 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf58fd7c-e363-466a-8de2-f2ec03aa6f40 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:40.364946 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf58fd7c-e363-466a-8de2-f2ec03aa6f40 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:40.365377 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf58fd7c-e363-466a-8de2-f2ec03aa6f40 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:40.366069 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf58fd7c-e363-466a-8de2-f2ec03aa6f40 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:40.366541 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf58fd7c-e363-466a-8de2-f2ec03aa6f40 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:40.366949 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf58fd7c-e363-466a-8de2-f2ec03aa6f40 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:40.380825 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 163/325] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:40 2022] GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730 => generated 1509 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:40.571690 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-cf58fd7c-e363-466a-8de2-f2ec03aa6f40 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:40.580506 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-cf58fd7c-e363-466a-8de2-f2ec03aa6f40 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:40.582444 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-cf58fd7c-e363-466a-8de2-f2ec03aa6f40 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:40.583711 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cf58fd7c-e363-466a-8de2-f2ec03aa6f40 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1740 microversion: 2.20 time: 0.238755 Aug 24 03:54:40.584368 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 163/326] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:40 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1740 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:54:40.827625 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-9014f9a1-e5de-456a-9f0d-3f90a5745999 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:40.828615 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-9014f9a1-e5de-456a-9f0d-3f90a5745999 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:40.835411 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9014f9a1-e5de-456a-9f0d-3f90a5745999 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:40.836178 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9014f9a1-e5de-456a-9f0d-3f90a5745999 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:40.836683 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9014f9a1-e5de-456a-9f0d-3f90a5745999 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:40.837590 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9014f9a1-e5de-456a-9f0d-3f90a5745999 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:40.838155 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9014f9a1-e5de-456a-9f0d-3f90a5745999 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:40.838602 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9014f9a1-e5de-456a-9f0d-3f90a5745999 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:40.908737 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-9014f9a1-e5de-456a-9f0d-3f90a5745999 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:40.915718 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-9014f9a1-e5de-456a-9f0d-3f90a5745999 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1254 microversion: 2.1 time: 0.094175 Aug 24 03:54:40.922839 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 164/327] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:40 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1254 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:41.388416 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bbdd9929-0374-4686-953c-73176b596356 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:41.389143 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bbdd9929-0374-4686-953c-73176b596356 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 13f1df4b-056e-4637-a0ec-54f6f78c8730] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:41.396475 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bbdd9929-0374-4686-953c-73176b596356 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:41.396957 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bbdd9929-0374-4686-953c-73176b596356 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:41.397388 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bbdd9929-0374-4686-953c-73176b596356 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:41.398201 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bbdd9929-0374-4686-953c-73176b596356 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:41.398756 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bbdd9929-0374-4686-953c-73176b596356 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:41.399179 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bbdd9929-0374-4686-953c-73176b596356 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:41.534305 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-bbdd9929-0374-4686-953c-73176b596356 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:41.542028 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bbdd9929-0374-4686-953c-73176b596356 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730" status: 200 len: 1515 microversion: 2.1 time: 0.157556 Aug 24 03:54:41.542606 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 164/328] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:41 2022] GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:41.608967 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-829a09ce-377e-485c-9639-744d1f2b6afe tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:41.609697 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-829a09ce-377e-485c-9639-744d1f2b6afe tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:41.616241 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-829a09ce-377e-485c-9639-744d1f2b6afe tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:41.616241 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-829a09ce-377e-485c-9639-744d1f2b6afe tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:41.616241 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-829a09ce-377e-485c-9639-744d1f2b6afe tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:41.616241 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-829a09ce-377e-485c-9639-744d1f2b6afe tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:41.621745 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-829a09ce-377e-485c-9639-744d1f2b6afe tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:41.621745 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-829a09ce-377e-485c-9639-744d1f2b6afe tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:41.754226 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-829a09ce-377e-485c-9639-744d1f2b6afe tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:41.762376 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-829a09ce-377e-485c-9639-744d1f2b6afe tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:41.763915 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-829a09ce-377e-485c-9639-744d1f2b6afe tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:41.765075 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-829a09ce-377e-485c-9639-744d1f2b6afe tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1740 microversion: 2.20 time: 0.160012 Aug 24 03:54:41.765630 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 165/329] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:41 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1740 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:54:41.942718 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-86edac09-b246-494c-8bfe-aacac1edd82c tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:41.943334 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-86edac09-b246-494c-8bfe-aacac1edd82c tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:41.949269 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-86edac09-b246-494c-8bfe-aacac1edd82c tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:41.949750 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-86edac09-b246-494c-8bfe-aacac1edd82c tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:41.950198 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-86edac09-b246-494c-8bfe-aacac1edd82c tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:41.950910 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-86edac09-b246-494c-8bfe-aacac1edd82c tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:41.951363 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-86edac09-b246-494c-8bfe-aacac1edd82c tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:41.951788 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-86edac09-b246-494c-8bfe-aacac1edd82c tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:42.014229 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-86edac09-b246-494c-8bfe-aacac1edd82c tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:42.022451 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-86edac09-b246-494c-8bfe-aacac1edd82c tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1254 microversion: 2.1 time: 0.084262 Aug 24 03:54:42.023058 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 165/330] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:41 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1254 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:42.789922 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-edf6036d-5fad-488a-89f0-ed2e116a6625 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:42.790636 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-edf6036d-5fad-488a-89f0-ed2e116a6625 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:42.801622 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-edf6036d-5fad-488a-89f0-ed2e116a6625 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:42.807755 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-edf6036d-5fad-488a-89f0-ed2e116a6625 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:42.807755 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-edf6036d-5fad-488a-89f0-ed2e116a6625 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:42.807755 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-edf6036d-5fad-488a-89f0-ed2e116a6625 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:42.807755 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-edf6036d-5fad-488a-89f0-ed2e116a6625 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:42.808158 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-edf6036d-5fad-488a-89f0-ed2e116a6625 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:43.045161 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7a0dada1-8a36-4942-a5ac-cc115721ebf7 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:43.046158 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7a0dada1-8a36-4942-a5ac-cc115721ebf7 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:43.055593 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7a0dada1-8a36-4942-a5ac-cc115721ebf7 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:43.056103 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7a0dada1-8a36-4942-a5ac-cc115721ebf7 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:43.056550 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7a0dada1-8a36-4942-a5ac-cc115721ebf7 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:43.057416 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7a0dada1-8a36-4942-a5ac-cc115721ebf7 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:43.057883 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7a0dada1-8a36-4942-a5ac-cc115721ebf7 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:43.058493 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7a0dada1-8a36-4942-a5ac-cc115721ebf7 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:43.070219 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-edf6036d-5fad-488a-89f0-ed2e116a6625 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:43.082213 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-edf6036d-5fad-488a-89f0-ed2e116a6625 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:43.086921 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-edf6036d-5fad-488a-89f0-ed2e116a6625 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:43.088424 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-edf6036d-5fad-488a-89f0-ed2e116a6625 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1740 microversion: 2.20 time: 0.302372 Aug 24 03:54:43.093121 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 166/331] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:42 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1740 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:54:43.406836 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-7a0dada1-8a36-4942-a5ac-cc115721ebf7 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:43.416687 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7a0dada1-8a36-4942-a5ac-cc115721ebf7 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1254 microversion: 2.1 time: 0.377400 Aug 24 03:54:43.417685 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 166/332] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:43 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1254 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:43.579788 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-88a87eca-558e-4207-adf4-998d3cf25c98 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1246221582", "imageRef": "c32522f7-22a8-45d4-a51e-f17637def2e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "35aecb0c-8d69-4fb0-8c17-38cb8c49008a"}], "security_groups": [{"name": "tempest-securitygroup--170892956"}], "key_name": "tempest-keypair-1852283799", "user_data": "}} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:43.730494 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.network.neutron [None req-88a87eca-558e-4207-adf4-998d3cf25c98 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] validate_networks() for [('35aecb0c-8d69-4fb0-8c17-38cb8c49008a', None, None, None, None, None)] {{(pid=127869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:54:44.117967 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-00a7836f-7a8b-4ec0-8022-183a1c5befcf tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:44.119186 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-00a7836f-7a8b-4ec0-8022-183a1c5befcf tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:44.128887 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00a7836f-7a8b-4ec0-8022-183a1c5befcf tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:44.130001 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00a7836f-7a8b-4ec0-8022-183a1c5befcf tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:44.130667 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00a7836f-7a8b-4ec0-8022-183a1c5befcf tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:44.131538 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00a7836f-7a8b-4ec0-8022-183a1c5befcf tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:44.132185 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00a7836f-7a8b-4ec0-8022-183a1c5befcf tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:44.132766 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00a7836f-7a8b-4ec0-8022-183a1c5befcf tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:44.187254 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-88a87eca-558e-4207-adf4-998d3cf25c98 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Flavor limits 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:54:44.188218 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-88a87eca-558e-4207-adf4-998d3cf25c98 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Image limits 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:54:44.188755 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-88a87eca-558e-4207-adf4-998d3cf25c98 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Flavor pref 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:54:44.189166 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-88a87eca-558e-4207-adf4-998d3cf25c98 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Image pref 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:54:44.189757 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-88a87eca-558e-4207-adf4-998d3cf25c98 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:54:44.200330 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-88a87eca-558e-4207-adf4-998d3cf25c98 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:44.203541 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-88a87eca-558e-4207-adf4-998d3cf25c98 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:44.203541 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-88a87eca-558e-4207-adf4-998d3cf25c98 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:44.203800 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-88a87eca-558e-4207-adf4-998d3cf25c98 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:44.204870 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-88a87eca-558e-4207-adf4-998d3cf25c98 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:44.205309 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-88a87eca-558e-4207-adf4-998d3cf25c98 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:44.231006 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.quota [None req-88a87eca-558e-4207-adf4-998d3cf25c98 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Getting quotas for project 46ef5b02d8da4d2eac26b6ccfb35e1a4. Resources: {'instances', 'cores', 'ram'} {{(pid=127869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:54:44.235442 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.quota [None req-88a87eca-558e-4207-adf4-998d3cf25c98 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Getting quotas for user e5582d10ebef459084fe287c18568f98 and project 46ef5b02d8da4d2eac26b6ccfb35e1a4. Resources: {'instances', 'cores', 'ram'} {{(pid=127869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:54:44.252341 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-88a87eca-558e-4207-adf4-998d3cf25c98 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Going to run 1 instances... {{(pid=127869) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:54:44.254961 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-88a87eca-558e-4207-adf4-998d3cf25c98 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: b7890971-d4d3-4a0e-bc58-b428eb8c5f0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c32522f7-22a8-45d4-a51e-f17637def2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:54:44.339033 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-00a7836f-7a8b-4ec0-8022-183a1c5befcf tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:44.352908 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-00a7836f-7a8b-4ec0-8022-183a1c5befcf tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:44.357297 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-00a7836f-7a8b-4ec0-8022-183a1c5befcf tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:44.377328 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-00a7836f-7a8b-4ec0-8022-183a1c5befcf tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1740 microversion: 2.20 time: 0.245077 Aug 24 03:54:44.378720 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 167/333] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:44 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1740 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:54:44.438292 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9035cd63-0349-493d-8956-dfa5aaf4c303 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:44.439104 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-88a87eca-558e-4207-adf4-998d3cf25c98 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.863809 Aug 24 03:54:44.444838 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 167/334] 10.222.0.82 () {60 vars in 1147 bytes} [Wed Aug 24 03:54:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:54:44.446398 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9035cd63-0349-493d-8956-dfa5aaf4c303 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:44.452700 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-1a365eba-f3b3-4afa-abff-b4ad6fc27612 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:44.453311 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-1a365eba-f3b3-4afa-abff-b4ad6fc27612 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: b7890971-d4d3-4a0e-bc58-b428eb8c5f0e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:44.456767 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9035cd63-0349-493d-8956-dfa5aaf4c303 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:44.457463 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9035cd63-0349-493d-8956-dfa5aaf4c303 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:44.460445 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9035cd63-0349-493d-8956-dfa5aaf4c303 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:44.461374 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9035cd63-0349-493d-8956-dfa5aaf4c303 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:44.462044 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9035cd63-0349-493d-8956-dfa5aaf4c303 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:44.462645 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9035cd63-0349-493d-8956-dfa5aaf4c303 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:44.559189 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-1a365eba-f3b3-4afa-abff-b4ad6fc27612 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:44.574114 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-1a365eba-f3b3-4afa-abff-b4ad6fc27612 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e" status: 200 len: 1242 microversion: 2.1 time: 0.126347 Aug 24 03:54:44.575916 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 168/335] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:44 2022] GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e => generated 1242 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:44.608031 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-9035cd63-0349-493d-8956-dfa5aaf4c303 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:44.631068 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9035cd63-0349-493d-8956-dfa5aaf4c303 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1318 microversion: 2.1 time: 0.196628 Aug 24 03:54:44.639031 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 168/336] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:44 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:44.821394 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-7d10bf0b-c62d-4c40-93f4-629a12117d0b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Action: 'create', calling method: .version_select at 0x7f155448daf0>, body: {"keypair": {"name": "tempest-keypair-1697432519", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHO4asGBNsbZNvvvUL62QG1VC3po/YQUETH8GKiMbbCy5H7gu4n1elB7cGsf0tmluTNFfcIslGQynSdTNaO/7QfD39QHUWEknN0yavhX0vR707cU+je/NDQUd8ZfNr/sfA=="}} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:44.841391 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.quota [None req-7d10bf0b-c62d-4c40-93f4-629a12117d0b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Getting quotas for project 63408551e1b24a86b8f0059f1a948896. Resources: {'key_pairs'} {{(pid=127869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:54:44.856355 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.quota [None req-7d10bf0b-c62d-4c40-93f4-629a12117d0b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Getting quotas for user 547bce0d8133462c95bcb6f272776a27 and project 63408551e1b24a86b8f0059f1a948896. Resources: {'key_pairs'} {{(pid=127869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:54:44.950462 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-7d10bf0b-c62d-4c40-93f4-629a12117d0b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.130631 Aug 24 03:54:44.950462 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 169/337] 10.222.0.82 () {60 vars in 1159 bytes} [Wed Aug 24 03:54:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:54:45.384159 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-eb6d9587-3af7-4f59-b57e-9de0f4970eec tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:45.385512 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-eb6d9587-3af7-4f59-b57e-9de0f4970eec tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:45.388254 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=4 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:45.403229 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb6d9587-3af7-4f59-b57e-9de0f4970eec tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:45.403735 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb6d9587-3af7-4f59-b57e-9de0f4970eec tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:45.404278 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb6d9587-3af7-4f59-b57e-9de0f4970eec tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:45.405133 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb6d9587-3af7-4f59-b57e-9de0f4970eec tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:45.405609 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb6d9587-3af7-4f59-b57e-9de0f4970eec tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:45.406263 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eb6d9587-3af7-4f59-b57e-9de0f4970eec tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:45.575817 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-eb6d9587-3af7-4f59-b57e-9de0f4970eec tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:45.584660 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-eb6d9587-3af7-4f59-b57e-9de0f4970eec tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:45.586159 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-eb6d9587-3af7-4f59-b57e-9de0f4970eec tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:45.587331 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-eb6d9587-3af7-4f59-b57e-9de0f4970eec tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1740 microversion: 2.20 time: 0.207263 Aug 24 03:54:45.587885 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 169/338] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:45 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1740 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:54:45.600308 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-3cad9e6e-c22c-4a39-a196-c6426f979afc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:45.601009 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-3cad9e6e-c22c-4a39-a196-c6426f979afc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: b7890971-d4d3-4a0e-bc58-b428eb8c5f0e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:45.655305 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-3cad9e6e-c22c-4a39-a196-c6426f979afc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:45.663515 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-3cad9e6e-c22c-4a39-a196-c6426f979afc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e" status: 200 len: 1242 microversion: 2.1 time: 0.067662 Aug 24 03:54:45.664070 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 170/339] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:45 2022] GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:45.664220 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c1d1d31f-0e46-4f01-8653-3b4e2debe91e tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:45.664755 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c1d1d31f-0e46-4f01-8653-3b4e2debe91e tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:45.670824 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c1d1d31f-0e46-4f01-8653-3b4e2debe91e tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:45.671820 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c1d1d31f-0e46-4f01-8653-3b4e2debe91e tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:45.671820 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c1d1d31f-0e46-4f01-8653-3b4e2debe91e tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:45.673115 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c1d1d31f-0e46-4f01-8653-3b4e2debe91e tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:45.673115 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c1d1d31f-0e46-4f01-8653-3b4e2debe91e tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:45.674043 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c1d1d31f-0e46-4f01-8653-3b4e2debe91e tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:45.745407 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-c1d1d31f-0e46-4f01-8653-3b4e2debe91e tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:45.753967 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c1d1d31f-0e46-4f01-8653-3b4e2debe91e tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1316 microversion: 2.1 time: 0.093543 Aug 24 03:54:45.754652 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 170/340] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:45 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1316 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:46.611375 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-113d81b7-9885-4509-af0c-96b2e89badeb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:46.624116 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-113d81b7-9885-4509-af0c-96b2e89badeb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:46.624116 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-113d81b7-9885-4509-af0c-96b2e89badeb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:46.624116 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-113d81b7-9885-4509-af0c-96b2e89badeb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:46.624116 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-113d81b7-9885-4509-af0c-96b2e89badeb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:46.624967 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-113d81b7-9885-4509-af0c-96b2e89badeb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:46.624967 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-113d81b7-9885-4509-af0c-96b2e89badeb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:46.624967 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-113d81b7-9885-4509-af0c-96b2e89badeb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:46.697025 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4498c7f8-8fb4-4254-9b41-ac9de0ea7596 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:46.698769 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4498c7f8-8fb4-4254-9b41-ac9de0ea7596 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: b7890971-d4d3-4a0e-bc58-b428eb8c5f0e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:46.712486 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4498c7f8-8fb4-4254-9b41-ac9de0ea7596 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:46.715984 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4498c7f8-8fb4-4254-9b41-ac9de0ea7596 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:46.720167 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4498c7f8-8fb4-4254-9b41-ac9de0ea7596 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:46.726029 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4498c7f8-8fb4-4254-9b41-ac9de0ea7596 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:46.731917 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4498c7f8-8fb4-4254-9b41-ac9de0ea7596 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:46.738952 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4498c7f8-8fb4-4254-9b41-ac9de0ea7596 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:46.880898 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-113d81b7-9885-4509-af0c-96b2e89badeb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:46.897789 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-113d81b7-9885-4509-af0c-96b2e89badeb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:46.899508 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-113d81b7-9885-4509-af0c-96b2e89badeb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:46.900545 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-113d81b7-9885-4509-af0c-96b2e89badeb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1740 microversion: 2.20 time: 0.293451 Aug 24 03:54:46.901092 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 171/341] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:46 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1740 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:54:46.905796 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-2f5c81d1-7e9c-4563-99a3-d09a2e5e4ccd tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:46.911293 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-2f5c81d1-7e9c-4563-99a3-d09a2e5e4ccd tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:46.921049 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2f5c81d1-7e9c-4563-99a3-d09a2e5e4ccd tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:46.927369 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2f5c81d1-7e9c-4563-99a3-d09a2e5e4ccd tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:46.928158 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2f5c81d1-7e9c-4563-99a3-d09a2e5e4ccd tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:46.929104 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2f5c81d1-7e9c-4563-99a3-d09a2e5e4ccd tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:46.930642 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2f5c81d1-7e9c-4563-99a3-d09a2e5e4ccd tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:46.931429 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2f5c81d1-7e9c-4563-99a3-d09a2e5e4ccd tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:46.981272 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:46.999204 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-4498c7f8-8fb4-4254-9b41-ac9de0ea7596 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:47.019777 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4498c7f8-8fb4-4254-9b41-ac9de0ea7596 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e" status: 200 len: 1246 microversion: 2.1 time: 0.335477 Aug 24 03:54:47.034047 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 171/342] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:46 2022] GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e => generated 1246 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:47.249057 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-2f5c81d1-7e9c-4563-99a3-d09a2e5e4ccd tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:47.260214 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-2f5c81d1-7e9c-4563-99a3-d09a2e5e4ccd tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1358 microversion: 2.1 time: 0.357908 Aug 24 03:54:47.260786 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 172/343] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:46 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1358 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:47.586157 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-e7eb2f50-2524-425d-b1f7-7dbeeb3449f9 req-d1a643a5-561a-4d5d-971f-268d4b969910 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0e4f072-3d61-4169-aba1-decacb716ac7", "tag": "1e23267f-b4be-439b-aa5f-3dbc95900806"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:47.612819 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-e7eb2f50-2524-425d-b1f7-7dbeeb3449f9 req-d1a643a5-561a-4d5d-971f-268d4b969910 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:47.613419 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-e7eb2f50-2524-425d-b1f7-7dbeeb3449f9 req-d1a643a5-561a-4d5d-971f-268d4b969910 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:47.613869 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-e7eb2f50-2524-425d-b1f7-7dbeeb3449f9 req-d1a643a5-561a-4d5d-971f-268d4b969910 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:47.642523 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-e7eb2f50-2524-425d-b1f7-7dbeeb3449f9 req-d1a643a5-561a-4d5d-971f-268d4b969910 service nova] Creating event network-changed:1e23267f-b4be-439b-aa5f-3dbc95900806 for instance e0e4f072-3d61-4169-aba1-decacb716ac7 on hv-cinder-85426 Aug 24 03:54:47.658863 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-e7eb2f50-2524-425d-b1f7-7dbeeb3449f9 req-d1a643a5-561a-4d5d-971f-268d4b969910 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079649 Aug 24 03:54:47.659966 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 172/344] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:54:47.936591 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-5b9f5b48-ebb4-4a29-b1bb-c0717d282ca2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:47.939124 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-5b9f5b48-ebb4-4a29-b1bb-c0717d282ca2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:47.947429 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5b9f5b48-ebb4-4a29-b1bb-c0717d282ca2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:47.948596 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5b9f5b48-ebb4-4a29-b1bb-c0717d282ca2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:47.949855 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5b9f5b48-ebb4-4a29-b1bb-c0717d282ca2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:47.952439 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5b9f5b48-ebb4-4a29-b1bb-c0717d282ca2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:47.953170 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5b9f5b48-ebb4-4a29-b1bb-c0717d282ca2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:47.953879 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5b9f5b48-ebb4-4a29-b1bb-c0717d282ca2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:48.049430 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6021d488-0a34-4ae0-a048-9aef23234d97 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:48.050133 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6021d488-0a34-4ae0-a048-9aef23234d97 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: b7890971-d4d3-4a0e-bc58-b428eb8c5f0e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:48.064015 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6021d488-0a34-4ae0-a048-9aef23234d97 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:48.064409 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6021d488-0a34-4ae0-a048-9aef23234d97 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:48.067852 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6021d488-0a34-4ae0-a048-9aef23234d97 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:48.069683 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6021d488-0a34-4ae0-a048-9aef23234d97 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:48.072681 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6021d488-0a34-4ae0-a048-9aef23234d97 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:48.075193 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6021d488-0a34-4ae0-a048-9aef23234d97 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:48.306280 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-5b9f5b48-ebb4-4a29-b1bb-c0717d282ca2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:48.327059 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-5b9f5b48-ebb4-4a29-b1bb-c0717d282ca2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:48.329384 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-5b9f5b48-ebb4-4a29-b1bb-c0717d282ca2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:48.330774 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-6021d488-0a34-4ae0-a048-9aef23234d97 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:48.331336 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-5b9f5b48-ebb4-4a29-b1bb-c0717d282ca2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1740 microversion: 2.20 time: 0.400978 Aug 24 03:54:48.332118 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 173/345] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:47 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1740 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:54:48.343253 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-88aaf704-e890-4634-8e07-de0f3a373781 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:48.347588 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-88aaf704-e890-4634-8e07-de0f3a373781 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:48.353721 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6021d488-0a34-4ae0-a048-9aef23234d97 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e" status: 200 len: 1294 microversion: 2.1 time: 0.309299 Aug 24 03:54:48.354867 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 173/346] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:48 2022] GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e => generated 1294 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:48.358001 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-88aaf704-e890-4634-8e07-de0f3a373781 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:48.358629 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-88aaf704-e890-4634-8e07-de0f3a373781 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:48.359592 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-88aaf704-e890-4634-8e07-de0f3a373781 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:48.365927 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-88aaf704-e890-4634-8e07-de0f3a373781 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:48.366460 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-88aaf704-e890-4634-8e07-de0f3a373781 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:48.367084 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-88aaf704-e890-4634-8e07-de0f3a373781 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:48.632843 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-88aaf704-e890-4634-8e07-de0f3a373781 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:48.643465 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-88aaf704-e890-4634-8e07-de0f3a373781 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1358 microversion: 2.1 time: 0.306977 Aug 24 03:54:48.644376 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 174/347] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:48 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1358 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:49.359024 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-094c0892-96dc-4435-9886-2323fafdb72c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:49.359897 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-094c0892-96dc-4435-9886-2323fafdb72c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:49.368333 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-094c0892-96dc-4435-9886-2323fafdb72c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:49.368828 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-094c0892-96dc-4435-9886-2323fafdb72c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:49.369273 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-094c0892-96dc-4435-9886-2323fafdb72c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:49.369981 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-094c0892-96dc-4435-9886-2323fafdb72c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:49.370435 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-094c0892-96dc-4435-9886-2323fafdb72c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:49.371378 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-094c0892-96dc-4435-9886-2323fafdb72c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:49.387322 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-a4aca122-9903-4e26-bba1-f7c4d2fbec56 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:49.388003 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-a4aca122-9903-4e26-bba1-f7c4d2fbec56 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: b7890971-d4d3-4a0e-bc58-b428eb8c5f0e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:49.390552 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:49.402535 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a4aca122-9903-4e26-bba1-f7c4d2fbec56 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:49.404095 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a4aca122-9903-4e26-bba1-f7c4d2fbec56 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:49.404633 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a4aca122-9903-4e26-bba1-f7c4d2fbec56 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:49.408759 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a4aca122-9903-4e26-bba1-f7c4d2fbec56 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:49.409379 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a4aca122-9903-4e26-bba1-f7c4d2fbec56 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:49.414036 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a4aca122-9903-4e26-bba1-f7c4d2fbec56 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:49.516936 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-a4aca122-9903-4e26-bba1-f7c4d2fbec56 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:49.527898 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-a4aca122-9903-4e26-bba1-f7c4d2fbec56 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e" status: 200 len: 1294 microversion: 2.1 time: 0.146523 Aug 24 03:54:49.538537 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 175/348] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:49 2022] GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e => generated 1294 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:49.669817 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-b4c430b0-e10e-48da-bcee-83a38bf69902 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:49.670791 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-b4c430b0-e10e-48da-bcee-83a38bf69902 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:49.684086 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b4c430b0-e10e-48da-bcee-83a38bf69902 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:49.684584 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b4c430b0-e10e-48da-bcee-83a38bf69902 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:49.685030 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b4c430b0-e10e-48da-bcee-83a38bf69902 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:49.686176 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b4c430b0-e10e-48da-bcee-83a38bf69902 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:49.686836 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b4c430b0-e10e-48da-bcee-83a38bf69902 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:49.687295 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b4c430b0-e10e-48da-bcee-83a38bf69902 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:49.703751 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-094c0892-96dc-4435-9886-2323fafdb72c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:49.710747 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=100 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:49.716930 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-094c0892-96dc-4435-9886-2323fafdb72c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:49.728505 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-094c0892-96dc-4435-9886-2323fafdb72c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:49.730007 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-094c0892-96dc-4435-9886-2323fafdb72c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1740 microversion: 2.20 time: 0.376698 Aug 24 03:54:49.731129 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 174/349] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:49 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1740 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:54:50.064519 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-b4c430b0-e10e-48da-bcee-83a38bf69902 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:50.076808 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-b4c430b0-e10e-48da-bcee-83a38bf69902 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1358 microversion: 2.1 time: 0.410770 Aug 24 03:54:50.077915 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 176/350] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:49 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1358 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:50.553320 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ed17a304-8aec-49a5-8881-55321bc5bac2 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:50.553968 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ed17a304-8aec-49a5-8881-55321bc5bac2 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: b7890971-d4d3-4a0e-bc58-b428eb8c5f0e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:50.560931 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed17a304-8aec-49a5-8881-55321bc5bac2 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:50.561407 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed17a304-8aec-49a5-8881-55321bc5bac2 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:50.561882 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed17a304-8aec-49a5-8881-55321bc5bac2 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:50.563179 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed17a304-8aec-49a5-8881-55321bc5bac2 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:50.563820 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed17a304-8aec-49a5-8881-55321bc5bac2 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:50.564245 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed17a304-8aec-49a5-8881-55321bc5bac2 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:50.624205 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-ed17a304-8aec-49a5-8881-55321bc5bac2 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:50.632691 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ed17a304-8aec-49a5-8881-55321bc5bac2 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e" status: 200 len: 1294 microversion: 2.1 time: 0.083153 Aug 24 03:54:50.633281 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 175/351] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:50 2022] GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e => generated 1294 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:50.759731 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-fed94aa0-6fe6-479b-b4b5-5e458aa3b8f0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:50.759731 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-fed94aa0-6fe6-479b-b4b5-5e458aa3b8f0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:50.765817 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-fed94aa0-6fe6-479b-b4b5-5e458aa3b8f0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:50.767120 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-fed94aa0-6fe6-479b-b4b5-5e458aa3b8f0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:50.767763 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-fed94aa0-6fe6-479b-b4b5-5e458aa3b8f0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:50.768466 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-fed94aa0-6fe6-479b-b4b5-5e458aa3b8f0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:50.768940 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-fed94aa0-6fe6-479b-b4b5-5e458aa3b8f0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:50.769341 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-fed94aa0-6fe6-479b-b4b5-5e458aa3b8f0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:50.982447 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-fed94aa0-6fe6-479b-b4b5-5e458aa3b8f0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:50.996443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-fed94aa0-6fe6-479b-b4b5-5e458aa3b8f0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:50.999543 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-fed94aa0-6fe6-479b-b4b5-5e458aa3b8f0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:51.024587 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-fed94aa0-6fe6-479b-b4b5-5e458aa3b8f0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1740 microversion: 2.20 time: 0.257143 Aug 24 03:54:51.024587 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 177/352] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:50 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1740 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:54:51.098123 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-da374e61-8252-4458-beba-acba7cd50dd8 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:51.101383 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-da374e61-8252-4458-beba-acba7cd50dd8 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:51.109970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-da374e61-8252-4458-beba-acba7cd50dd8 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:51.117795 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-da374e61-8252-4458-beba-acba7cd50dd8 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:51.119588 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-da374e61-8252-4458-beba-acba7cd50dd8 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:51.121237 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-da374e61-8252-4458-beba-acba7cd50dd8 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:51.126495 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-da374e61-8252-4458-beba-acba7cd50dd8 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:51.127624 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-da374e61-8252-4458-beba-acba7cd50dd8 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:51.236591 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-96801d08-5260-4cb7-99b3-7241dae960ed tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-569115921", "imageRef": "c32522f7-22a8-45d4-a51e-f17637def2e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7f2b1e59-498c-4054-b07b-db142e3ad98d"}], "security_groups": [{"name": "tempest-securitygroup--963893806"}], "key_name": "tempest-keypair-1697432519", "user_data": "}} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:51.512137 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-da374e61-8252-4458-beba-acba7cd50dd8 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:51.522676 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-da374e61-8252-4458-beba-acba7cd50dd8 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1358 microversion: 2.1 time: 0.429137 Aug 24 03:54:51.527171 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 176/353] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:51 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1358 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:51.653969 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-73c99bc1-fc09-4928-a7ca-81eefbf00ba6 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:51.654915 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-73c99bc1-fc09-4928-a7ca-81eefbf00ba6 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: b7890971-d4d3-4a0e-bc58-b428eb8c5f0e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:51.671300 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73c99bc1-fc09-4928-a7ca-81eefbf00ba6 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:51.677930 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73c99bc1-fc09-4928-a7ca-81eefbf00ba6 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:51.678624 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73c99bc1-fc09-4928-a7ca-81eefbf00ba6 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:51.679557 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73c99bc1-fc09-4928-a7ca-81eefbf00ba6 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:51.682819 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73c99bc1-fc09-4928-a7ca-81eefbf00ba6 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:51.683494 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73c99bc1-fc09-4928-a7ca-81eefbf00ba6 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:51.806859 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-73c99bc1-fc09-4928-a7ca-81eefbf00ba6 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:51.821625 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-73c99bc1-fc09-4928-a7ca-81eefbf00ba6 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e" status: 200 len: 1312 microversion: 2.1 time: 0.172140 Aug 24 03:54:51.834531 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 177/354] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:51 2022] GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e => generated 1312 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:52.049251 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4eacb3ef-23cf-4257-bab7-d1a1b13d745d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:52.049887 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4eacb3ef-23cf-4257-bab7-d1a1b13d745d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:52.056076 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4eacb3ef-23cf-4257-bab7-d1a1b13d745d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:52.056493 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4eacb3ef-23cf-4257-bab7-d1a1b13d745d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:52.056930 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4eacb3ef-23cf-4257-bab7-d1a1b13d745d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:52.057898 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4eacb3ef-23cf-4257-bab7-d1a1b13d745d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:52.058086 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4eacb3ef-23cf-4257-bab7-d1a1b13d745d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:52.058537 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4eacb3ef-23cf-4257-bab7-d1a1b13d745d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:52.198916 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-4eacb3ef-23cf-4257-bab7-d1a1b13d745d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:52.209956 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-4eacb3ef-23cf-4257-bab7-d1a1b13d745d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:52.211865 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-4eacb3ef-23cf-4257-bab7-d1a1b13d745d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:52.217184 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4eacb3ef-23cf-4257-bab7-d1a1b13d745d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1740 microversion: 2.20 time: 0.169246 Aug 24 03:54:52.217184 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 178/355] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:52 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1740 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:54:52.547210 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5484637d-6767-4d02-ae5e-64c406072e9c tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:52.548554 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5484637d-6767-4d02-ae5e-64c406072e9c tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:52.565814 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5484637d-6767-4d02-ae5e-64c406072e9c tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:52.568631 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5484637d-6767-4d02-ae5e-64c406072e9c tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:52.571923 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5484637d-6767-4d02-ae5e-64c406072e9c tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:52.575979 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5484637d-6767-4d02-ae5e-64c406072e9c tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:52.577155 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5484637d-6767-4d02-ae5e-64c406072e9c tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:52.577607 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5484637d-6767-4d02-ae5e-64c406072e9c tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:52.791191 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-5484637d-6767-4d02-ae5e-64c406072e9c tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:52.801603 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5484637d-6767-4d02-ae5e-64c406072e9c tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1358 microversion: 2.1 time: 0.259634 Aug 24 03:54:52.818707 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 179/356] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:52 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1358 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:52.851299 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3bfe751d-8dd1-4aaf-bdc7-8c4002b29d6a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:52.852509 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3bfe751d-8dd1-4aaf-bdc7-8c4002b29d6a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: b7890971-d4d3-4a0e-bc58-b428eb8c5f0e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:52.867233 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3bfe751d-8dd1-4aaf-bdc7-8c4002b29d6a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:52.867743 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3bfe751d-8dd1-4aaf-bdc7-8c4002b29d6a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:52.869854 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3bfe751d-8dd1-4aaf-bdc7-8c4002b29d6a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:52.869854 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3bfe751d-8dd1-4aaf-bdc7-8c4002b29d6a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:52.870922 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3bfe751d-8dd1-4aaf-bdc7-8c4002b29d6a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:52.871704 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3bfe751d-8dd1-4aaf-bdc7-8c4002b29d6a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:53.034661 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-3bfe751d-8dd1-4aaf-bdc7-8c4002b29d6a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:53.036870 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.network.neutron [None req-96801d08-5260-4cb7-99b3-7241dae960ed tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] validate_networks() for [('7f2b1e59-498c-4054-b07b-db142e3ad98d', None, None, None, None, None)] {{(pid=127869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:54:53.044161 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3bfe751d-8dd1-4aaf-bdc7-8c4002b29d6a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e" status: 200 len: 1300 microversion: 2.1 time: 0.197251 Aug 24 03:54:53.059084 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 180/357] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:52 2022] GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e => generated 1300 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:53.239360 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8d98be92-a04e-4c20-99ca-5a80f78dc09e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:53.240249 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8d98be92-a04e-4c20-99ca-5a80f78dc09e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:53.246405 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8d98be92-a04e-4c20-99ca-5a80f78dc09e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:53.247184 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8d98be92-a04e-4c20-99ca-5a80f78dc09e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:53.247792 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8d98be92-a04e-4c20-99ca-5a80f78dc09e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:53.248680 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8d98be92-a04e-4c20-99ca-5a80f78dc09e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:53.249292 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8d98be92-a04e-4c20-99ca-5a80f78dc09e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:53.250067 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8d98be92-a04e-4c20-99ca-5a80f78dc09e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:53.526786 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-8d98be92-a04e-4c20-99ca-5a80f78dc09e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:53.526786 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-8d98be92-a04e-4c20-99ca-5a80f78dc09e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:53.527156 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-8d98be92-a04e-4c20-99ca-5a80f78dc09e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:53.527156 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8d98be92-a04e-4c20-99ca-5a80f78dc09e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1740 microversion: 2.20 time: 0.252499 Aug 24 03:54:53.527156 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 181/358] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:53 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1740 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:54:53.701423 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1767e658-c0aa-45fd-8e20-e99d7421d983 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:53.717864 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1767e658-c0aa-45fd-8e20-e99d7421d983 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:53.718367 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1767e658-c0aa-45fd-8e20-e99d7421d983 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:53.718992 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1767e658-c0aa-45fd-8e20-e99d7421d983 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:53.788407 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-96801d08-5260-4cb7-99b3-7241dae960ed tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Flavor limits 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:54:53.788992 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-96801d08-5260-4cb7-99b3-7241dae960ed tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Image limits 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:54:53.789463 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-96801d08-5260-4cb7-99b3-7241dae960ed tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Flavor pref 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:54:53.790043 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-96801d08-5260-4cb7-99b3-7241dae960ed tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Image pref 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:54:53.790719 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-96801d08-5260-4cb7-99b3-7241dae960ed tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:54:53.793867 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1767e658-c0aa-45fd-8e20-e99d7421d983 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Going to try to stop instance {{(pid=127870) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 03:54:53.802121 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-96801d08-5260-4cb7-99b3-7241dae960ed tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:53.803032 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-96801d08-5260-4cb7-99b3-7241dae960ed tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:53.803700 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-96801d08-5260-4cb7-99b3-7241dae960ed tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:53.804612 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-96801d08-5260-4cb7-99b3-7241dae960ed tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:53.805244 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-96801d08-5260-4cb7-99b3-7241dae960ed tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:53.805665 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-96801d08-5260-4cb7-99b3-7241dae960ed tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:53.825264 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.quota [None req-96801d08-5260-4cb7-99b3-7241dae960ed tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Getting quotas for project 63408551e1b24a86b8f0059f1a948896. Resources: {'instances', 'cores', 'ram'} {{(pid=127869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:54:53.830098 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.quota [None req-96801d08-5260-4cb7-99b3-7241dae960ed tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Getting quotas for user 547bce0d8133462c95bcb6f272776a27 and project 63408551e1b24a86b8f0059f1a948896. Resources: {'instances', 'cores', 'ram'} {{(pid=127869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:54:53.842415 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-96801d08-5260-4cb7-99b3-7241dae960ed tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Going to run 1 instances... {{(pid=127869) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:54:53.844817 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-96801d08-5260-4cb7-99b3-7241dae960ed tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c32522f7-22a8-45d4-a51e-f17637def2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:54:54.214046 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-96801d08-5260-4cb7-99b3-7241dae960ed tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.981673 Aug 24 03:54:54.218234 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 178/359] 10.222.0.82 () {60 vars in 1147 bytes} [Wed Aug 24 03:54:51 2022] POST /compute/v2.1/servers => generated 408 bytes in 2986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 03:54:54.224885 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-10baa7bb-9ece-4f9c-a0f2-9f5174e65d27 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:54.226250 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-10baa7bb-9ece-4f9c-a0f2-9f5174e65d27 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:54.235776 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-10baa7bb-9ece-4f9c-a0f2-9f5174e65d27 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:54.239951 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-10baa7bb-9ece-4f9c-a0f2-9f5174e65d27 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:54.239951 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-10baa7bb-9ece-4f9c-a0f2-9f5174e65d27 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:54.239951 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-10baa7bb-9ece-4f9c-a0f2-9f5174e65d27 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:54.239951 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-10baa7bb-9ece-4f9c-a0f2-9f5174e65d27 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:54.240400 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-10baa7bb-9ece-4f9c-a0f2-9f5174e65d27 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:54.350062 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1767e658-c0aa-45fd-8e20-e99d7421d983 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "POST /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6/action" status: 202 len: 0 microversion: 2.1 time: 0.646169 Aug 24 03:54:54.350062 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 182/360] 10.222.0.82 () {60 vars in 1278 bytes} [Wed Aug 24 03:54:53 2022] POST /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6/action => generated 0 bytes in 648 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:54:54.352120 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-39c7b71b-8f03-435d-8ec4-1ec00fd6430c tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:54.352824 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-39c7b71b-8f03-435d-8ec4-1ec00fd6430c tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: b7890971-d4d3-4a0e-bc58-b428eb8c5f0e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:54.381762 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-39c7b71b-8f03-435d-8ec4-1ec00fd6430c tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:54.384953 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-39c7b71b-8f03-435d-8ec4-1ec00fd6430c tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:54.385606 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-39c7b71b-8f03-435d-8ec4-1ec00fd6430c tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:54.387287 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-39c7b71b-8f03-435d-8ec4-1ec00fd6430c tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:54.387950 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-39c7b71b-8f03-435d-8ec4-1ec00fd6430c tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:54.391836 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-39c7b71b-8f03-435d-8ec4-1ec00fd6430c tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:54.763986 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-39c7b71b-8f03-435d-8ec4-1ec00fd6430c tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:54.776005 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-39c7b71b-8f03-435d-8ec4-1ec00fd6430c tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e" status: 200 len: 1367 microversion: 2.1 time: 0.429477 Aug 24 03:54:54.776709 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 183/361] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:54 2022] GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e => generated 1367 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:54.794833 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ba0fc7a4-8472-46b6-8083-a93b40cd91e8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:54.799930 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ba0fc7a4-8472-46b6-8083-a93b40cd91e8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:54.817495 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-10baa7bb-9ece-4f9c-a0f2-9f5174e65d27 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:54.826943 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-10baa7bb-9ece-4f9c-a0f2-9f5174e65d27 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1358 microversion: 2.1 time: 0.606789 Aug 24 03:54:54.828408 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 179/362] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:54 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1358 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:54.833157 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-f6a00b6a-9930-4dc6-9096-b573b2312257 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:54.834035 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-f6a00b6a-9930-4dc6-9096-b573b2312257 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:54.840183 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f6a00b6a-9930-4dc6-9096-b573b2312257 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:54.840930 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f6a00b6a-9930-4dc6-9096-b573b2312257 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:54.841472 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f6a00b6a-9930-4dc6-9096-b573b2312257 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:54.842268 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f6a00b6a-9930-4dc6-9096-b573b2312257 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:54.842851 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f6a00b6a-9930-4dc6-9096-b573b2312257 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:54.844124 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f6a00b6a-9930-4dc6-9096-b573b2312257 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:54.872241 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-ba0fc7a4-8472-46b6-8083-a93b40cd91e8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:54.880768 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ba0fc7a4-8472-46b6-8083-a93b40cd91e8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1245 microversion: 2.1 time: 0.100783 Aug 24 03:54:54.881809 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 184/363] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:54 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1245 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:54.886637 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-42d5d7d2-f0ac-4b18-9d1a-fc913a12ddbb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:54.887498 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-42d5d7d2-f0ac-4b18-9d1a-fc913a12ddbb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:54.894446 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-42d5d7d2-f0ac-4b18-9d1a-fc913a12ddbb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:54.895094 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-42d5d7d2-f0ac-4b18-9d1a-fc913a12ddbb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:54.895627 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-42d5d7d2-f0ac-4b18-9d1a-fc913a12ddbb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:54.896420 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-42d5d7d2-f0ac-4b18-9d1a-fc913a12ddbb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:54.897108 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-42d5d7d2-f0ac-4b18-9d1a-fc913a12ddbb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:54.897649 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-42d5d7d2-f0ac-4b18-9d1a-fc913a12ddbb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:55.004780 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-f6a00b6a-9930-4dc6-9096-b573b2312257 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:55.021271 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-f6a00b6a-9930-4dc6-9096-b573b2312257 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1722 microversion: 2.1 time: 0.191555 Aug 24 03:54:55.022057 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 180/364] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:54 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:55.122160 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-42d5d7d2-f0ac-4b18-9d1a-fc913a12ddbb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:55.135158 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-42d5d7d2-f0ac-4b18-9d1a-fc913a12ddbb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:55.143356 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-42d5d7d2-f0ac-4b18-9d1a-fc913a12ddbb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:55.143356 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-42d5d7d2-f0ac-4b18-9d1a-fc913a12ddbb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1740 microversion: 2.20 time: 0.255248 Aug 24 03:54:55.143356 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 185/365] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:54 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1740 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:54:55.804392 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-2e7d0b74-5d96-452a-923d-e4699f7c243b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:55.805916 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-2e7d0b74-5d96-452a-923d-e4699f7c243b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: b7890971-d4d3-4a0e-bc58-b428eb8c5f0e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:55.812711 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2e7d0b74-5d96-452a-923d-e4699f7c243b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:55.813434 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2e7d0b74-5d96-452a-923d-e4699f7c243b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:55.814162 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2e7d0b74-5d96-452a-923d-e4699f7c243b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:55.815041 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2e7d0b74-5d96-452a-923d-e4699f7c243b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:55.815841 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2e7d0b74-5d96-452a-923d-e4699f7c243b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:55.816406 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2e7d0b74-5d96-452a-923d-e4699f7c243b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:55.849850 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2338ee63-5f31-4619-bed6-6786a120dc94 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:55.851105 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2338ee63-5f31-4619-bed6-6786a120dc94 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:55.863498 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2338ee63-5f31-4619-bed6-6786a120dc94 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:55.864103 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2338ee63-5f31-4619-bed6-6786a120dc94 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:55.864610 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2338ee63-5f31-4619-bed6-6786a120dc94 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:55.865379 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2338ee63-5f31-4619-bed6-6786a120dc94 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:55.866042 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2338ee63-5f31-4619-bed6-6786a120dc94 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:55.866724 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2338ee63-5f31-4619-bed6-6786a120dc94 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:56.025146 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-2e7d0b74-5d96-452a-923d-e4699f7c243b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:56.035467 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-2e7d0b74-5d96-452a-923d-e4699f7c243b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e" status: 200 len: 1367 microversion: 2.1 time: 0.235035 Aug 24 03:54:56.043510 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 181/366] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:55 2022] GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:56.053992 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-6553bd9f-9eca-4872-9916-34e97e5f1e33 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:56.054678 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-6553bd9f-9eca-4872-9916-34e97e5f1e33 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:56.060926 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6553bd9f-9eca-4872-9916-34e97e5f1e33 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:56.061957 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6553bd9f-9eca-4872-9916-34e97e5f1e33 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:56.063247 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6553bd9f-9eca-4872-9916-34e97e5f1e33 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:56.064195 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6553bd9f-9eca-4872-9916-34e97e5f1e33 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:56.064817 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6553bd9f-9eca-4872-9916-34e97e5f1e33 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:56.065399 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6553bd9f-9eca-4872-9916-34e97e5f1e33 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:56.109220 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-2338ee63-5f31-4619-bed6-6786a120dc94 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:56.118059 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2338ee63-5f31-4619-bed6-6786a120dc94 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1358 microversion: 2.1 time: 0.272183 Aug 24 03:54:56.118962 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 186/367] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:55 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1358 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:56.124467 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-eea3ea55-2695-48e0-ad81-fbb963fc9b7c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:56.125837 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-eea3ea55-2695-48e0-ad81-fbb963fc9b7c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:56.133673 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eea3ea55-2695-48e0-ad81-fbb963fc9b7c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:56.134418 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eea3ea55-2695-48e0-ad81-fbb963fc9b7c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:56.135047 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eea3ea55-2695-48e0-ad81-fbb963fc9b7c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:56.135911 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eea3ea55-2695-48e0-ad81-fbb963fc9b7c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:56.136515 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eea3ea55-2695-48e0-ad81-fbb963fc9b7c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:56.137088 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eea3ea55-2695-48e0-ad81-fbb963fc9b7c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:56.167632 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-6553bd9f-9eca-4872-9916-34e97e5f1e33 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:56.176345 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-6553bd9f-9eca-4872-9916-34e97e5f1e33 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1249 microversion: 2.1 time: 0.131332 Aug 24 03:54:56.177880 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 182/368] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:56 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1249 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:56.183070 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-8f989df6-874f-47e2-a330-8bc28dd0f005 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:56.183848 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-8f989df6-874f-47e2-a330-8bc28dd0f005 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:56.190939 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8f989df6-874f-47e2-a330-8bc28dd0f005 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:56.193221 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8f989df6-874f-47e2-a330-8bc28dd0f005 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:56.194317 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8f989df6-874f-47e2-a330-8bc28dd0f005 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:56.195358 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8f989df6-874f-47e2-a330-8bc28dd0f005 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:56.195937 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8f989df6-874f-47e2-a330-8bc28dd0f005 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:56.196465 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8f989df6-874f-47e2-a330-8bc28dd0f005 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:56.291870 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-eea3ea55-2695-48e0-ad81-fbb963fc9b7c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:56.301323 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-eea3ea55-2695-48e0-ad81-fbb963fc9b7c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1722 microversion: 2.1 time: 0.181136 Aug 24 03:54:56.302540 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 187/369] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:56 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:56.370170 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-8f989df6-874f-47e2-a330-8bc28dd0f005 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:56.386288 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-8f989df6-874f-47e2-a330-8bc28dd0f005 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:56.388199 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-8f989df6-874f-47e2-a330-8bc28dd0f005 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:56.395996 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-8f989df6-874f-47e2-a330-8bc28dd0f005 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1740 microversion: 2.20 time: 0.210324 Aug 24 03:54:56.395996 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 183/370] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:56 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1740 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:54:57.057263 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e928ec2f-e7d8-4db0-a49b-7fdac3331e9e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:57.057878 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e928ec2f-e7d8-4db0-a49b-7fdac3331e9e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: b7890971-d4d3-4a0e-bc58-b428eb8c5f0e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:57.065143 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e928ec2f-e7d8-4db0-a49b-7fdac3331e9e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:57.066485 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e928ec2f-e7d8-4db0-a49b-7fdac3331e9e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:57.066485 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e928ec2f-e7d8-4db0-a49b-7fdac3331e9e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:57.066931 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e928ec2f-e7d8-4db0-a49b-7fdac3331e9e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:57.067236 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e928ec2f-e7d8-4db0-a49b-7fdac3331e9e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:57.067604 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e928ec2f-e7d8-4db0-a49b-7fdac3331e9e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:57.154279 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-97a7c2e6-6db1-48a9-97ff-e98a8bf55958 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:57.154922 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-97a7c2e6-6db1-48a9-97ff-e98a8bf55958 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:57.167525 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-97a7c2e6-6db1-48a9-97ff-e98a8bf55958 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:57.168244 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-97a7c2e6-6db1-48a9-97ff-e98a8bf55958 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:57.168869 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-97a7c2e6-6db1-48a9-97ff-e98a8bf55958 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:57.169791 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-97a7c2e6-6db1-48a9-97ff-e98a8bf55958 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:57.170464 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-97a7c2e6-6db1-48a9-97ff-e98a8bf55958 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:57.179742 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-97a7c2e6-6db1-48a9-97ff-e98a8bf55958 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:57.236499 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-e928ec2f-e7d8-4db0-a49b-7fdac3331e9e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:57.251973 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e928ec2f-e7d8-4db0-a49b-7fdac3331e9e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e" status: 200 len: 1367 microversion: 2.1 time: 0.199048 Aug 24 03:54:57.252771 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 188/371] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:57 2022] GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:57.269774 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e8199957-5ca0-4ad0-ac55-67491216b3de tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:57.270412 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e8199957-5ca0-4ad0-ac55-67491216b3de tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:57.276593 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8199957-5ca0-4ad0-ac55-67491216b3de tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:57.277092 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8199957-5ca0-4ad0-ac55-67491216b3de tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:57.277533 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8199957-5ca0-4ad0-ac55-67491216b3de tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:57.278329 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8199957-5ca0-4ad0-ac55-67491216b3de tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:57.278740 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8199957-5ca0-4ad0-ac55-67491216b3de tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:57.279168 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8199957-5ca0-4ad0-ac55-67491216b3de tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:57.367874 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-e8199957-5ca0-4ad0-ac55-67491216b3de tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:57.378419 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e8199957-5ca0-4ad0-ac55-67491216b3de tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1249 microversion: 2.1 time: 0.124411 Aug 24 03:54:57.379359 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 189/372] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:57 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1249 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:57.386224 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-22a0a32c-badd-425c-8fd3-f5b37f1fa533 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:57.388289 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-22a0a32c-badd-425c-8fd3-f5b37f1fa533 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:57.395250 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22a0a32c-badd-425c-8fd3-f5b37f1fa533 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:57.403101 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22a0a32c-badd-425c-8fd3-f5b37f1fa533 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:57.403101 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22a0a32c-badd-425c-8fd3-f5b37f1fa533 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:57.403101 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22a0a32c-badd-425c-8fd3-f5b37f1fa533 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:57.403101 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22a0a32c-badd-425c-8fd3-f5b37f1fa533 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:57.403507 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22a0a32c-badd-425c-8fd3-f5b37f1fa533 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:57.448170 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-97a7c2e6-6db1-48a9-97ff-e98a8bf55958 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:57.457286 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-97a7c2e6-6db1-48a9-97ff-e98a8bf55958 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1358 microversion: 2.1 time: 0.309070 Aug 24 03:54:57.471663 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 184/373] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:57 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1358 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:57.477749 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-d14e734e-4a88-437f-aaed-f84f12a215b9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:57.478384 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-d14e734e-4a88-437f-aaed-f84f12a215b9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:57.485964 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d14e734e-4a88-437f-aaed-f84f12a215b9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:57.486474 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d14e734e-4a88-437f-aaed-f84f12a215b9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:57.486942 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d14e734e-4a88-437f-aaed-f84f12a215b9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:57.487654 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d14e734e-4a88-437f-aaed-f84f12a215b9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:57.488709 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d14e734e-4a88-437f-aaed-f84f12a215b9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:57.489140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d14e734e-4a88-437f-aaed-f84f12a215b9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:57.614723 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-22a0a32c-badd-425c-8fd3-f5b37f1fa533 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:57.623454 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-22a0a32c-badd-425c-8fd3-f5b37f1fa533 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1722 microversion: 2.1 time: 0.242863 Aug 24 03:54:57.634347 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 190/374] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:57 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1722 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:57.670263 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-d14e734e-4a88-437f-aaed-f84f12a215b9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:57.679245 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-d14e734e-4a88-437f-aaed-f84f12a215b9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:57.680754 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-d14e734e-4a88-437f-aaed-f84f12a215b9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:57.681906 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-d14e734e-4a88-437f-aaed-f84f12a215b9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1740 microversion: 2.20 time: 0.209209 Aug 24 03:54:57.682451 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 185/375] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:57 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1740 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:54:58.273602 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-051e9241-2cc8-44f2-aeea-35f5267e796d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:58.274246 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-051e9241-2cc8-44f2-aeea-35f5267e796d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: b7890971-d4d3-4a0e-bc58-b428eb8c5f0e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:58.280865 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-051e9241-2cc8-44f2-aeea-35f5267e796d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:58.281648 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-051e9241-2cc8-44f2-aeea-35f5267e796d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:58.281767 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-051e9241-2cc8-44f2-aeea-35f5267e796d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:58.282440 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-051e9241-2cc8-44f2-aeea-35f5267e796d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:58.282923 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-051e9241-2cc8-44f2-aeea-35f5267e796d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:58.283336 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-051e9241-2cc8-44f2-aeea-35f5267e796d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:58.304169 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:58.401667 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-d1e7113f-5a3f-4325-b7c3-e3e6b11cfc19 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:58.402354 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-d1e7113f-5a3f-4325-b7c3-e3e6b11cfc19 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:58.409340 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d1e7113f-5a3f-4325-b7c3-e3e6b11cfc19 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:58.409818 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d1e7113f-5a3f-4325-b7c3-e3e6b11cfc19 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:58.410247 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d1e7113f-5a3f-4325-b7c3-e3e6b11cfc19 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:58.411061 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d1e7113f-5a3f-4325-b7c3-e3e6b11cfc19 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:58.411489 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d1e7113f-5a3f-4325-b7c3-e3e6b11cfc19 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:58.411904 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d1e7113f-5a3f-4325-b7c3-e3e6b11cfc19 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:58.460156 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-051e9241-2cc8-44f2-aeea-35f5267e796d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:58.469240 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-051e9241-2cc8-44f2-aeea-35f5267e796d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e" status: 200 len: 1367 microversion: 2.1 time: 0.199136 Aug 24 03:54:58.479098 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 191/376] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:58 2022] GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:58.480931 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3ebf95f3-b613-4104-ad57-cb2683e9645a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:58.481565 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3ebf95f3-b613-4104-ad57-cb2683e9645a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:58.481673 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-d1e7113f-5a3f-4325-b7c3-e3e6b11cfc19 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:58.490251 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-d1e7113f-5a3f-4325-b7c3-e3e6b11cfc19 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1249 microversion: 2.1 time: 0.093015 Aug 24 03:54:58.490847 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 186/377] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:58 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1249 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:58.491349 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3ebf95f3-b613-4104-ad57-cb2683e9645a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:58.491900 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3ebf95f3-b613-4104-ad57-cb2683e9645a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:58.492334 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3ebf95f3-b613-4104-ad57-cb2683e9645a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:58.493046 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3ebf95f3-b613-4104-ad57-cb2683e9645a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:58.493491 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3ebf95f3-b613-4104-ad57-cb2683e9645a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:58.493907 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3ebf95f3-b613-4104-ad57-cb2683e9645a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:58.645429 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-4d1fca0d-4342-49dc-93f7-4048125840f2 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:58.646609 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-4d1fca0d-4342-49dc-93f7-4048125840f2 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:58.652737 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4d1fca0d-4342-49dc-93f7-4048125840f2 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:58.653507 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4d1fca0d-4342-49dc-93f7-4048125840f2 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:58.654162 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4d1fca0d-4342-49dc-93f7-4048125840f2 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:58.655119 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4d1fca0d-4342-49dc-93f7-4048125840f2 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:58.655850 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4d1fca0d-4342-49dc-93f7-4048125840f2 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:58.657157 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4d1fca0d-4342-49dc-93f7-4048125840f2 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:58.663865 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-3ebf95f3-b613-4104-ad57-cb2683e9645a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:58.673163 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3ebf95f3-b613-4104-ad57-cb2683e9645a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1358 microversion: 2.1 time: 0.196043 Aug 24 03:54:58.674680 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 192/378] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:58 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:58.716479 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0b8599b4-17ac-4227-b128-3d19922d63aa tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:58.717097 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0b8599b4-17ac-4227-b128-3d19922d63aa tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:58.723573 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0b8599b4-17ac-4227-b128-3d19922d63aa tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:58.724059 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0b8599b4-17ac-4227-b128-3d19922d63aa tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:58.724497 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0b8599b4-17ac-4227-b128-3d19922d63aa tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:58.725310 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0b8599b4-17ac-4227-b128-3d19922d63aa tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:58.725761 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0b8599b4-17ac-4227-b128-3d19922d63aa tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:58.726183 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0b8599b4-17ac-4227-b128-3d19922d63aa tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:58.888406 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-4d1fca0d-4342-49dc-93f7-4048125840f2 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:58.907866 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-0b8599b4-17ac-4227-b128-3d19922d63aa tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:58.919510 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-0b8599b4-17ac-4227-b128-3d19922d63aa tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:58.927047 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-0b8599b4-17ac-4227-b128-3d19922d63aa tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:58.927201 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-4d1fca0d-4342-49dc-93f7-4048125840f2 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1722 microversion: 2.1 time: 0.272082 Aug 24 03:54:58.927201 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 187/379] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:58 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1722 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:58.927449 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0b8599b4-17ac-4227-b128-3d19922d63aa tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1740 microversion: 2.20 time: 0.209781 Aug 24 03:54:58.935094 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 193/380] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:58 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1740 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:54:59.456513 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-4c95552e-9bbc-487a-a125-e1841f30f6f5 req-0aa4eddd-5167-4d1d-b4c8-7b9b3b52d262 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7890971-d4d3-4a0e-bc58-b428eb8c5f0e", "tag": "898dcdfe-5a41-42a9-ab1f-09c5ef9e676b"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:59.466368 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-4c95552e-9bbc-487a-a125-e1841f30f6f5 req-0aa4eddd-5167-4d1d-b4c8-7b9b3b52d262 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:59.467017 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-4c95552e-9bbc-487a-a125-e1841f30f6f5 req-0aa4eddd-5167-4d1d-b4c8-7b9b3b52d262 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:59.467427 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-4c95552e-9bbc-487a-a125-e1841f30f6f5 req-0aa4eddd-5167-4d1d-b4c8-7b9b3b52d262 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:59.479379 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-4c95552e-9bbc-487a-a125-e1841f30f6f5 req-0aa4eddd-5167-4d1d-b4c8-7b9b3b52d262 service nova] Creating event network-changed:898dcdfe-5a41-42a9-ab1f-09c5ef9e676b for instance b7890971-d4d3-4a0e-bc58-b428eb8c5f0e on hv-cinder-85426 Aug 24 03:54:59.485104 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-4c95552e-9bbc-487a-a125-e1841f30f6f5 req-0aa4eddd-5167-4d1d-b4c8-7b9b3b52d262 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031936 Aug 24 03:54:59.485702 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 188/381] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:54:59.491001 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-07a6f387-47a6-4ecf-ac01-a0fbb69b3498 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:59.491823 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-07a6f387-47a6-4ecf-ac01-a0fbb69b3498 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: b7890971-d4d3-4a0e-bc58-b428eb8c5f0e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:59.498691 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-07a6f387-47a6-4ecf-ac01-a0fbb69b3498 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:59.506056 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-07a6f387-47a6-4ecf-ac01-a0fbb69b3498 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:59.506056 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-07a6f387-47a6-4ecf-ac01-a0fbb69b3498 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:59.506056 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-07a6f387-47a6-4ecf-ac01-a0fbb69b3498 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:59.506056 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-07a6f387-47a6-4ecf-ac01-a0fbb69b3498 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:59.506424 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-07a6f387-47a6-4ecf-ac01-a0fbb69b3498 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:59.513193 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-607c3f37-1404-4243-9470-c3d528972981 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:59.514947 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-607c3f37-1404-4243-9470-c3d528972981 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:59.522205 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-607c3f37-1404-4243-9470-c3d528972981 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:59.523041 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-607c3f37-1404-4243-9470-c3d528972981 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:59.523693 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-607c3f37-1404-4243-9470-c3d528972981 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:59.524877 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-607c3f37-1404-4243-9470-c3d528972981 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:59.525610 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-607c3f37-1404-4243-9470-c3d528972981 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:59.526220 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-607c3f37-1404-4243-9470-c3d528972981 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:59.597232 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-607c3f37-1404-4243-9470-c3d528972981 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:59.604889 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-607c3f37-1404-4243-9470-c3d528972981 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1241 microversion: 2.1 time: 0.096654 Aug 24 03:54:59.606414 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 189/382] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:59 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1241 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:59.681920 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-07a6f387-47a6-4ecf-ac01-a0fbb69b3498 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:59.695509 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-07a6f387-47a6-4ecf-ac01-a0fbb69b3498 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e" status: 200 len: 1367 microversion: 2.1 time: 0.206552 Aug 24 03:54:59.695509 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 194/383] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:59 2022] GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:59.697367 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-f0e776c2-e6b5-472c-90fe-8b48bfe3809f tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:59.699611 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-f0e776c2-e6b5-472c-90fe-8b48bfe3809f tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:59.708769 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f0e776c2-e6b5-472c-90fe-8b48bfe3809f tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:59.709613 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f0e776c2-e6b5-472c-90fe-8b48bfe3809f tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:59.710302 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f0e776c2-e6b5-472c-90fe-8b48bfe3809f tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:59.712389 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f0e776c2-e6b5-472c-90fe-8b48bfe3809f tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:59.713361 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f0e776c2-e6b5-472c-90fe-8b48bfe3809f tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:59.714025 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f0e776c2-e6b5-472c-90fe-8b48bfe3809f tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:59.740869 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell1:SELECT=100 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:59.949230 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-755b92da-71af-4da8-bc2d-85e640c398a9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:59.950562 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-755b92da-71af-4da8-bc2d-85e640c398a9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:59.960797 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-755b92da-71af-4da8-bc2d-85e640c398a9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:59.961693 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-755b92da-71af-4da8-bc2d-85e640c398a9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:59.962223 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-755b92da-71af-4da8-bc2d-85e640c398a9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:59.963202 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-755b92da-71af-4da8-bc2d-85e640c398a9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:59.963878 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-755b92da-71af-4da8-bc2d-85e640c398a9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:59.964310 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-755b92da-71af-4da8-bc2d-85e640c398a9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:59.967114 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-f0e776c2-e6b5-472c-90fe-8b48bfe3809f tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:59.986773 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-f0e776c2-e6b5-472c-90fe-8b48bfe3809f tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1358 microversion: 2.1 time: 0.285307 Aug 24 03:54:59.986773 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 190/384] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:59 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1358 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:59.997856 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-4e477679-dcc5-45a1-8dac-79ff99316720 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:59.998963 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-4e477679-dcc5-45a1-8dac-79ff99316720 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:00.024676 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4e477679-dcc5-45a1-8dac-79ff99316720 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:00.025318 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4e477679-dcc5-45a1-8dac-79ff99316720 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:00.025859 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4e477679-dcc5-45a1-8dac-79ff99316720 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:00.026856 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4e477679-dcc5-45a1-8dac-79ff99316720 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:00.027592 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4e477679-dcc5-45a1-8dac-79ff99316720 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:00.028316 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4e477679-dcc5-45a1-8dac-79ff99316720 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:00.186610 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-755b92da-71af-4da8-bc2d-85e640c398a9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:00.195574 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-755b92da-71af-4da8-bc2d-85e640c398a9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1722 microversion: 2.1 time: 0.254042 Aug 24 03:55:00.200775 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 195/385] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:59 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1722 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:00.201178 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-4e477679-dcc5-45a1-8dac-79ff99316720 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:00.208462 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-4e477679-dcc5-45a1-8dac-79ff99316720 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:00.209947 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-4e477679-dcc5-45a1-8dac-79ff99316720 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:00.211149 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-4e477679-dcc5-45a1-8dac-79ff99316720 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1722 microversion: 2.20 time: 0.232597 Aug 24 03:55:00.211697 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 191/386] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:59 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:00.631032 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-54461247-0bf7-49ac-b6fb-6c19b2184a86 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:00.631644 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-54461247-0bf7-49ac-b6fb-6c19b2184a86 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:00.638090 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54461247-0bf7-49ac-b6fb-6c19b2184a86 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:00.638628 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54461247-0bf7-49ac-b6fb-6c19b2184a86 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:00.639065 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54461247-0bf7-49ac-b6fb-6c19b2184a86 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:00.639825 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54461247-0bf7-49ac-b6fb-6c19b2184a86 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:00.641204 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54461247-0bf7-49ac-b6fb-6c19b2184a86 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:00.641924 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54461247-0bf7-49ac-b6fb-6c19b2184a86 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:00.715977 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-bc35ea63-1203-4859-806e-11f4e09dd05d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:00.716680 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-bc35ea63-1203-4859-806e-11f4e09dd05d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: b7890971-d4d3-4a0e-bc58-b428eb8c5f0e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:00.716877 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-54461247-0bf7-49ac-b6fb-6c19b2184a86 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:00.724369 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bc35ea63-1203-4859-806e-11f4e09dd05d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:00.724947 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bc35ea63-1203-4859-806e-11f4e09dd05d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:00.725450 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bc35ea63-1203-4859-806e-11f4e09dd05d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:00.726259 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bc35ea63-1203-4859-806e-11f4e09dd05d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:00.726919 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bc35ea63-1203-4859-806e-11f4e09dd05d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:00.727341 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bc35ea63-1203-4859-806e-11f4e09dd05d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:00.728641 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-54461247-0bf7-49ac-b6fb-6c19b2184a86 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1297 microversion: 2.1 time: 0.101513 Aug 24 03:55:00.729225 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 196/387] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:00 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1297 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:00.870778 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-bc35ea63-1203-4859-806e-11f4e09dd05d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:00.878213 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-bc35ea63-1203-4859-806e-11f4e09dd05d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e" status: 200 len: 1367 microversion: 2.1 time: 0.168744 Aug 24 03:55:00.878801 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 192/388] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:00 2022] GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:55:00.999862 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-30d783e8-1ceb-4798-b886-d7f1fe19a7b6 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:01.000909 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-30d783e8-1ceb-4798-b886-d7f1fe19a7b6 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:01.012877 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-30d783e8-1ceb-4798-b886-d7f1fe19a7b6 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:01.014019 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-30d783e8-1ceb-4798-b886-d7f1fe19a7b6 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:01.018046 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-30d783e8-1ceb-4798-b886-d7f1fe19a7b6 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:01.019195 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-30d783e8-1ceb-4798-b886-d7f1fe19a7b6 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:01.021305 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-30d783e8-1ceb-4798-b886-d7f1fe19a7b6 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:01.021852 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-30d783e8-1ceb-4798-b886-d7f1fe19a7b6 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:01.183869 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-30d783e8-1ceb-4798-b886-d7f1fe19a7b6 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:01.193048 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-30d783e8-1ceb-4798-b886-d7f1fe19a7b6 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1358 microversion: 2.1 time: 0.198926 Aug 24 03:55:01.194068 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 197/389] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:00 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:01.217089 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-a0b0f42f-996f-4f6d-a4b3-6bfcf9322632 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:01.226398 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-a0b0f42f-996f-4f6d-a4b3-6bfcf9322632 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:01.226398 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a0b0f42f-996f-4f6d-a4b3-6bfcf9322632 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:01.226398 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a0b0f42f-996f-4f6d-a4b3-6bfcf9322632 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:01.226398 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a0b0f42f-996f-4f6d-a4b3-6bfcf9322632 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:01.226811 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a0b0f42f-996f-4f6d-a4b3-6bfcf9322632 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:01.226811 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a0b0f42f-996f-4f6d-a4b3-6bfcf9322632 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:01.226811 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a0b0f42f-996f-4f6d-a4b3-6bfcf9322632 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:01.237932 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8f36cab8-a61c-4a98-aa33-bb00c3f73c4a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:01.238593 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8f36cab8-a61c-4a98-aa33-bb00c3f73c4a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:01.245844 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8f36cab8-a61c-4a98-aa33-bb00c3f73c4a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:01.246348 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8f36cab8-a61c-4a98-aa33-bb00c3f73c4a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:01.246828 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8f36cab8-a61c-4a98-aa33-bb00c3f73c4a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:01.247532 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8f36cab8-a61c-4a98-aa33-bb00c3f73c4a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:01.248005 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8f36cab8-a61c-4a98-aa33-bb00c3f73c4a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:01.248414 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8f36cab8-a61c-4a98-aa33-bb00c3f73c4a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:01.375846 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-a0b0f42f-996f-4f6d-a4b3-6bfcf9322632 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:01.380851 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-a0b0f42f-996f-4f6d-a4b3-6bfcf9322632 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1722 microversion: 2.1 time: 0.167645 Aug 24 03:55:01.381676 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 193/390] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:01 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:01.460910 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-8f36cab8-a61c-4a98-aa33-bb00c3f73c4a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:01.461393 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-8f36cab8-a61c-4a98-aa33-bb00c3f73c4a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:01.464115 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-8f36cab8-a61c-4a98-aa33-bb00c3f73c4a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:01.465634 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8f36cab8-a61c-4a98-aa33-bb00c3f73c4a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1722 microversion: 2.20 time: 0.232247 Aug 24 03:55:01.466678 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 198/391] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:01 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:01.757004 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-0459a59b-ea8a-4f62-9e86-f06095612e14 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:01.757661 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-0459a59b-ea8a-4f62-9e86-f06095612e14 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:01.764090 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0459a59b-ea8a-4f62-9e86-f06095612e14 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:01.764579 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0459a59b-ea8a-4f62-9e86-f06095612e14 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:01.766014 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0459a59b-ea8a-4f62-9e86-f06095612e14 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:01.766777 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0459a59b-ea8a-4f62-9e86-f06095612e14 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:01.767221 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0459a59b-ea8a-4f62-9e86-f06095612e14 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:01.767647 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0459a59b-ea8a-4f62-9e86-f06095612e14 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:01.831881 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-0459a59b-ea8a-4f62-9e86-f06095612e14 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:01.839422 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-0459a59b-ea8a-4f62-9e86-f06095612e14 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1305 microversion: 2.1 time: 0.086207 Aug 24 03:55:01.839985 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 194/392] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:01 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1305 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:55:01.900536 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-abcae8f5-ceb2-4a2e-a300-785b878015d8 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:01.901174 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-abcae8f5-ceb2-4a2e-a300-785b878015d8 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: b7890971-d4d3-4a0e-bc58-b428eb8c5f0e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:01.908054 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-abcae8f5-ceb2-4a2e-a300-785b878015d8 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:01.908536 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-abcae8f5-ceb2-4a2e-a300-785b878015d8 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:01.908967 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-abcae8f5-ceb2-4a2e-a300-785b878015d8 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:01.909667 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-abcae8f5-ceb2-4a2e-a300-785b878015d8 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:01.910099 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-abcae8f5-ceb2-4a2e-a300-785b878015d8 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:01.910528 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-abcae8f5-ceb2-4a2e-a300-785b878015d8 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:02.046958 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-abcae8f5-ceb2-4a2e-a300-785b878015d8 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:02.054901 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-abcae8f5-ceb2-4a2e-a300-785b878015d8 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e" status: 200 len: 1367 microversion: 2.1 time: 0.158149 Aug 24 03:55:02.055466 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 199/393] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:01 2022] GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:02.214604 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-142a4f38-2c25-4490-8073-cbf3ca7c8f02 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:02.215216 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-142a4f38-2c25-4490-8073-cbf3ca7c8f02 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:02.221786 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-142a4f38-2c25-4490-8073-cbf3ca7c8f02 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:02.222269 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-142a4f38-2c25-4490-8073-cbf3ca7c8f02 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:02.224613 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-142a4f38-2c25-4490-8073-cbf3ca7c8f02 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:02.225334 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-142a4f38-2c25-4490-8073-cbf3ca7c8f02 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:02.225787 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-142a4f38-2c25-4490-8073-cbf3ca7c8f02 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:02.226210 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-142a4f38-2c25-4490-8073-cbf3ca7c8f02 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:02.360878 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-142a4f38-2c25-4490-8073-cbf3ca7c8f02 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:02.368421 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-142a4f38-2c25-4490-8073-cbf3ca7c8f02 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1358 microversion: 2.1 time: 0.157684 Aug 24 03:55:02.368991 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 195/394] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:02 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:02.402671 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a1ac319c-6c2e-4b65-ac0e-9d8a9dddda17 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:02.403287 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a1ac319c-6c2e-4b65-ac0e-9d8a9dddda17 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:02.410475 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a1ac319c-6c2e-4b65-ac0e-9d8a9dddda17 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:02.410999 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a1ac319c-6c2e-4b65-ac0e-9d8a9dddda17 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:02.411439 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a1ac319c-6c2e-4b65-ac0e-9d8a9dddda17 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:02.412139 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a1ac319c-6c2e-4b65-ac0e-9d8a9dddda17 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:02.412595 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a1ac319c-6c2e-4b65-ac0e-9d8a9dddda17 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:02.413020 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a1ac319c-6c2e-4b65-ac0e-9d8a9dddda17 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:02.489633 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-4ca4e32c-6e4a-4c61-be8e-4972d6839d1d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:02.490243 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-4ca4e32c-6e4a-4c61-be8e-4972d6839d1d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:02.496667 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4ca4e32c-6e4a-4c61-be8e-4972d6839d1d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:02.497167 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4ca4e32c-6e4a-4c61-be8e-4972d6839d1d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:02.497738 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4ca4e32c-6e4a-4c61-be8e-4972d6839d1d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:02.498381 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4ca4e32c-6e4a-4c61-be8e-4972d6839d1d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:02.498865 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4ca4e32c-6e4a-4c61-be8e-4972d6839d1d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:02.499952 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4ca4e32c-6e4a-4c61-be8e-4972d6839d1d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:02.555944 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-a1ac319c-6c2e-4b65-ac0e-9d8a9dddda17 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:02.565034 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a1ac319c-6c2e-4b65-ac0e-9d8a9dddda17 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1722 microversion: 2.1 time: 0.166317 Aug 24 03:55:02.574477 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 200/395] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:02 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:02.645370 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-4ca4e32c-6e4a-4c61-be8e-4972d6839d1d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:02.654089 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-4ca4e32c-6e4a-4c61-be8e-4972d6839d1d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:02.655745 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-4ca4e32c-6e4a-4c61-be8e-4972d6839d1d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:02.657118 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-4ca4e32c-6e4a-4c61-be8e-4972d6839d1d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1722 microversion: 2.20 time: 0.172544 Aug 24 03:55:02.657677 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 196/396] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:02 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:55:02.864743 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ad3dbfca-43c6-4506-bc2b-5462d89b23f4 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:02.865729 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ad3dbfca-43c6-4506-bc2b-5462d89b23f4 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:02.875604 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad3dbfca-43c6-4506-bc2b-5462d89b23f4 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:02.876117 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad3dbfca-43c6-4506-bc2b-5462d89b23f4 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:02.876613 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad3dbfca-43c6-4506-bc2b-5462d89b23f4 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:02.877337 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad3dbfca-43c6-4506-bc2b-5462d89b23f4 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:02.877790 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad3dbfca-43c6-4506-bc2b-5462d89b23f4 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:02.878212 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad3dbfca-43c6-4506-bc2b-5462d89b23f4 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:02.943636 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-ad3dbfca-43c6-4506-bc2b-5462d89b23f4 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:02.951765 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ad3dbfca-43c6-4506-bc2b-5462d89b23f4 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1305 microversion: 2.1 time: 0.094337 Aug 24 03:55:02.953106 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 201/397] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:02 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1305 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:55:03.077878 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-aa972d33-2adb-44f6-8044-88dd5920b3d3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:03.078564 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-aa972d33-2adb-44f6-8044-88dd5920b3d3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: b7890971-d4d3-4a0e-bc58-b428eb8c5f0e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:03.085109 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-aa972d33-2adb-44f6-8044-88dd5920b3d3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:03.085838 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-aa972d33-2adb-44f6-8044-88dd5920b3d3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:03.086323 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-aa972d33-2adb-44f6-8044-88dd5920b3d3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:03.087048 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-aa972d33-2adb-44f6-8044-88dd5920b3d3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:03.087712 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-aa972d33-2adb-44f6-8044-88dd5920b3d3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:03.088316 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-aa972d33-2adb-44f6-8044-88dd5920b3d3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:03.349801 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-aa972d33-2adb-44f6-8044-88dd5920b3d3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:03.382418 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-aa972d33-2adb-44f6-8044-88dd5920b3d3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e" status: 200 len: 1367 microversion: 2.1 time: 0.307089 Aug 24 03:55:03.383187 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 197/398] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:03 2022] GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e => generated 1367 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:03.389362 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-16e7cbd9-856b-47cb-85be-906fc2cad738 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:03.393564 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-16e7cbd9-856b-47cb-85be-906fc2cad738 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:03.400881 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-16e7cbd9-856b-47cb-85be-906fc2cad738 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:03.401536 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-16e7cbd9-856b-47cb-85be-906fc2cad738 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:03.402076 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-16e7cbd9-856b-47cb-85be-906fc2cad738 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:03.415465 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-16e7cbd9-856b-47cb-85be-906fc2cad738 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:03.416476 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-16e7cbd9-856b-47cb-85be-906fc2cad738 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:03.422485 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-16e7cbd9-856b-47cb-85be-906fc2cad738 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:03.585839 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-16e7cbd9-856b-47cb-85be-906fc2cad738 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:03.588129 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-63906a2e-260e-4282-8022-453b87915669 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:03.589276 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-63906a2e-260e-4282-8022-453b87915669 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:03.594643 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-16e7cbd9-856b-47cb-85be-906fc2cad738 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1358 microversion: 2.1 time: 0.209240 Aug 24 03:55:03.596074 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 202/399] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:03 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1358 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:03.600652 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-63906a2e-260e-4282-8022-453b87915669 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:03.601960 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-63906a2e-260e-4282-8022-453b87915669 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:03.602589 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-63906a2e-260e-4282-8022-453b87915669 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:03.604166 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-63906a2e-260e-4282-8022-453b87915669 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:03.604777 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-63906a2e-260e-4282-8022-453b87915669 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:03.605728 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-63906a2e-260e-4282-8022-453b87915669 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:03.692049 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0beaaf16-0c8a-437d-a425-18a9a10badab tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:03.692681 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0beaaf16-0c8a-437d-a425-18a9a10badab tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:03.725862 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0beaaf16-0c8a-437d-a425-18a9a10badab tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:03.726363 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0beaaf16-0c8a-437d-a425-18a9a10badab tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:03.726839 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0beaaf16-0c8a-437d-a425-18a9a10badab tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:03.727552 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0beaaf16-0c8a-437d-a425-18a9a10badab tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:03.728009 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0beaaf16-0c8a-437d-a425-18a9a10badab tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:03.728430 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0beaaf16-0c8a-437d-a425-18a9a10badab tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:03.777776 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-63906a2e-260e-4282-8022-453b87915669 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:03.799418 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-63906a2e-260e-4282-8022-453b87915669 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1722 microversion: 2.1 time: 0.215480 Aug 24 03:55:03.800537 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 198/400] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:03 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:03.811218 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-fee77d22-a628-45d0-8f60-00a97e252d5f req-c0fd03a7-a462-4891-8c36-798995fef1eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8b22210-7e08-4f01-bf00-d84b0e5e34d7", "name": "network-vif-unplugged", "status": "completed", "tag": "a6ef21fe-e9ce-414a-a115-1f2f2babf6fc"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:03.820082 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell0:SELECT=6 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:03.838801 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell0:SELECT=34 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:03.841083 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-fee77d22-a628-45d0-8f60-00a97e252d5f req-c0fd03a7-a462-4891-8c36-798995fef1eb service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:03.841913 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-fee77d22-a628-45d0-8f60-00a97e252d5f req-c0fd03a7-a462-4891-8c36-798995fef1eb service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:03.842555 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-fee77d22-a628-45d0-8f60-00a97e252d5f req-c0fd03a7-a462-4891-8c36-798995fef1eb service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:03.857179 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-fee77d22-a628-45d0-8f60-00a97e252d5f req-c0fd03a7-a462-4891-8c36-798995fef1eb service nova] Creating event network-vif-unplugged:a6ef21fe-e9ce-414a-a115-1f2f2babf6fc for instance b8b22210-7e08-4f01-bf00-d84b0e5e34d7 on hv-cinder-85426 Aug 24 03:55:03.863987 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-fee77d22-a628-45d0-8f60-00a97e252d5f req-c0fd03a7-a462-4891-8c36-798995fef1eb service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061653 Aug 24 03:55:03.864802 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 199/401] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:03.940779 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-0beaaf16-0c8a-437d-a425-18a9a10badab tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:03.949319 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-0beaaf16-0c8a-437d-a425-18a9a10badab tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:03.950855 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-0beaaf16-0c8a-437d-a425-18a9a10badab tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:03.952785 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0beaaf16-0c8a-437d-a425-18a9a10badab tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1725 microversion: 2.20 time: 0.276057 Aug 24 03:55:03.953906 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 203/402] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:03 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1725 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:55:03.974064 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-8982dc3d-9416-47a9-ba2c-26a66ec264be tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:03.975078 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-8982dc3d-9416-47a9-ba2c-26a66ec264be tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:03.987366 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8982dc3d-9416-47a9-ba2c-26a66ec264be tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:03.988991 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8982dc3d-9416-47a9-ba2c-26a66ec264be tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:03.991083 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8982dc3d-9416-47a9-ba2c-26a66ec264be tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:03.992016 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8982dc3d-9416-47a9-ba2c-26a66ec264be tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:03.992382 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e22e4f24-4d01-4d8d-9bb0-b6f7729acd04 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b50fd527-c6d8-4e0d-92bd-857ebfcad8ea"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:03.995233 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e22e4f24-4d01-4d8d-9bb0-b6f7729acd04 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:03.995985 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8982dc3d-9416-47a9-ba2c-26a66ec264be tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:03.996601 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8982dc3d-9416-47a9-ba2c-26a66ec264be tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:04.013814 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e22e4f24-4d01-4d8d-9bb0-b6f7729acd04 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:04.020603 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e22e4f24-4d01-4d8d-9bb0-b6f7729acd04 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:04.023158 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e22e4f24-4d01-4d8d-9bb0-b6f7729acd04 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:04.023709 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e22e4f24-4d01-4d8d-9bb0-b6f7729acd04 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:04.027825 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e22e4f24-4d01-4d8d-9bb0-b6f7729acd04 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:04.028508 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e22e4f24-4d01-4d8d-9bb0-b6f7729acd04 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:04.160999 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-8982dc3d-9416-47a9-ba2c-26a66ec264be tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:04.170625 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-8982dc3d-9416-47a9-ba2c-26a66ec264be tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1303 microversion: 2.1 time: 0.200074 Aug 24 03:55:04.171707 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 200/403] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:03 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1303 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:04.408050 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-6de5ac4f-0799-45a7-88ae-0b22c6d58ac5 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:04.409202 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-6de5ac4f-0799-45a7-88ae-0b22c6d58ac5 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: b7890971-d4d3-4a0e-bc58-b428eb8c5f0e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:04.418984 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6de5ac4f-0799-45a7-88ae-0b22c6d58ac5 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:04.419731 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6de5ac4f-0799-45a7-88ae-0b22c6d58ac5 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:04.420395 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6de5ac4f-0799-45a7-88ae-0b22c6d58ac5 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:04.422361 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6de5ac4f-0799-45a7-88ae-0b22c6d58ac5 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:04.423025 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6de5ac4f-0799-45a7-88ae-0b22c6d58ac5 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:04.423614 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6de5ac4f-0799-45a7-88ae-0b22c6d58ac5 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:04.675823 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-6de5ac4f-0799-45a7-88ae-0b22c6d58ac5 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:04.686819 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-6de5ac4f-0799-45a7-88ae-0b22c6d58ac5 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e" status: 200 len: 1367 microversion: 2.1 time: 0.283260 Aug 24 03:55:04.690459 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 201/404] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:04 2022] GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e => generated 1367 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:04.701095 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-bb6a14c9-7253-4a24-93c8-769ae5b5cc69 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:04.702329 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-bb6a14c9-7253-4a24-93c8-769ae5b5cc69 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:04.713978 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bb6a14c9-7253-4a24-93c8-769ae5b5cc69 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:04.715419 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bb6a14c9-7253-4a24-93c8-769ae5b5cc69 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:04.716374 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bb6a14c9-7253-4a24-93c8-769ae5b5cc69 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:04.719124 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bb6a14c9-7253-4a24-93c8-769ae5b5cc69 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:04.720822 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bb6a14c9-7253-4a24-93c8-769ae5b5cc69 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:04.721361 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bb6a14c9-7253-4a24-93c8-769ae5b5cc69 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:04.878340 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:04.980168 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-bb6a14c9-7253-4a24-93c8-769ae5b5cc69 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:04.990304 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-bb6a14c9-7253-4a24-93c8-769ae5b5cc69 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1358 microversion: 2.1 time: 0.301082 Aug 24 03:55:04.991005 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 202/405] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:04 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1358 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:04.995596 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-9b762a69-05a1-49e5-9631-19e69f3217a3 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:04.996259 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-9b762a69-05a1-49e5-9631-19e69f3217a3 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:05.011742 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9b762a69-05a1-49e5-9631-19e69f3217a3 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:05.012573 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9b762a69-05a1-49e5-9631-19e69f3217a3 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:05.012573 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9b762a69-05a1-49e5-9631-19e69f3217a3 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:05.012573 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9b762a69-05a1-49e5-9631-19e69f3217a3 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:05.016941 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9b762a69-05a1-49e5-9631-19e69f3217a3 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:05.016941 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9b762a69-05a1-49e5-9631-19e69f3217a3 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:05.298729 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-9b762a69-05a1-49e5-9631-19e69f3217a3 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:05.307769 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-9b762a69-05a1-49e5-9631-19e69f3217a3 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1722 microversion: 2.1 time: 0.315605 Aug 24 03:55:05.308353 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 203/406] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:04 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1722 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:05.314072 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-49232a72-83f5-4fd4-95b5-0d4ae48f98da tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:05.314937 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-49232a72-83f5-4fd4-95b5-0d4ae48f98da tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:05.333693 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-49232a72-83f5-4fd4-95b5-0d4ae48f98da tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:05.334180 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-49232a72-83f5-4fd4-95b5-0d4ae48f98da tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:05.334666 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-49232a72-83f5-4fd4-95b5-0d4ae48f98da tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:05.335444 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-49232a72-83f5-4fd4-95b5-0d4ae48f98da tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:05.335900 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-49232a72-83f5-4fd4-95b5-0d4ae48f98da tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:05.336320 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-49232a72-83f5-4fd4-95b5-0d4ae48f98da tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:05.583129 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-49232a72-83f5-4fd4-95b5-0d4ae48f98da tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:05.591570 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-49232a72-83f5-4fd4-95b5-0d4ae48f98da tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1370 microversion: 2.1 time: 0.281572 Aug 24 03:55:05.591881 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 204/407] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:05 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1370 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:05.699026 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e22e4f24-4d01-4d8d-9bb0-b6f7729acd04 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "POST /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.718431 Aug 24 03:55:05.700478 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 204/408] 10.222.0.82 () {62 vars in 1364 bytes} [Wed Aug 24 03:55:03 2022] POST /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7/os-volume_attachments => generated 188 bytes in 1721 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:55:05.714991 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-17299a1a-7376-4c06-be6b-b5ab8c01d9ab tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:05.715792 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-17299a1a-7376-4c06-be6b-b5ab8c01d9ab tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: b7890971-d4d3-4a0e-bc58-b428eb8c5f0e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:05.740346 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-17299a1a-7376-4c06-be6b-b5ab8c01d9ab tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:05.742828 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-17299a1a-7376-4c06-be6b-b5ab8c01d9ab tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:05.743295 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-17299a1a-7376-4c06-be6b-b5ab8c01d9ab tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:05.745910 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-17299a1a-7376-4c06-be6b-b5ab8c01d9ab tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:05.746427 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-17299a1a-7376-4c06-be6b-b5ab8c01d9ab tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:05.747014 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-17299a1a-7376-4c06-be6b-b5ab8c01d9ab tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:05.872224 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-71434f07-8754-4092-ba58-7d0ca0ac1e85 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:05.872926 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-71434f07-8754-4092-ba58-7d0ca0ac1e85 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:05.881698 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71434f07-8754-4092-ba58-7d0ca0ac1e85 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:05.883759 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71434f07-8754-4092-ba58-7d0ca0ac1e85 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:05.883759 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71434f07-8754-4092-ba58-7d0ca0ac1e85 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:05.883759 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71434f07-8754-4092-ba58-7d0ca0ac1e85 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:05.885014 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71434f07-8754-4092-ba58-7d0ca0ac1e85 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:05.885014 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-71434f07-8754-4092-ba58-7d0ca0ac1e85 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:05.909524 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:05.941450 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-71434f07-8754-4092-ba58-7d0ca0ac1e85 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127870) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 03:55:06.047295 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-17299a1a-7376-4c06-be6b-b5ab8c01d9ab tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:06.055046 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-17299a1a-7376-4c06-be6b-b5ab8c01d9ab tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e" status: 200 len: 1367 microversion: 2.1 time: 0.344347 Aug 24 03:55:06.055656 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 205/409] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:05 2022] GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e => generated 1367 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:06.060189 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-b2442fae-1ed0-470f-8971-c6a91a168d87 req-b29b4a32-a359-4def-8081-9c83ec2bc034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0e4f072-3d61-4169-aba1-decacb716ac7", "name": "network-vif-plugged", "status": "completed", "tag": "1e23267f-b4be-439b-aa5f-3dbc95900806"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:06.070289 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-b2442fae-1ed0-470f-8971-c6a91a168d87 req-b29b4a32-a359-4def-8081-9c83ec2bc034 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:06.070828 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-b2442fae-1ed0-470f-8971-c6a91a168d87 req-b29b4a32-a359-4def-8081-9c83ec2bc034 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:06.071252 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-b2442fae-1ed0-470f-8971-c6a91a168d87 req-b29b4a32-a359-4def-8081-9c83ec2bc034 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:06.083366 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-b2442fae-1ed0-470f-8971-c6a91a168d87 req-b29b4a32-a359-4def-8081-9c83ec2bc034 service nova] Creating event network-vif-plugged:1e23267f-b4be-439b-aa5f-3dbc95900806 for instance e0e4f072-3d61-4169-aba1-decacb716ac7 on hv-cinder-85426 Aug 24 03:55:06.089893 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-b2442fae-1ed0-470f-8971-c6a91a168d87 req-b29b4a32-a359-4def-8081-9c83ec2bc034 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032603 Aug 24 03:55:06.090527 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 206/410] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:06.097069 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-1e65ca7f-eb95-484f-a4b9-db1fed68d2f2 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:06.098538 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-1e65ca7f-eb95-484f-a4b9-db1fed68d2f2 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:06.105687 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1e65ca7f-eb95-484f-a4b9-db1fed68d2f2 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:06.106172 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1e65ca7f-eb95-484f-a4b9-db1fed68d2f2 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:06.106668 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1e65ca7f-eb95-484f-a4b9-db1fed68d2f2 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:06.107566 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1e65ca7f-eb95-484f-a4b9-db1fed68d2f2 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:06.108880 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1e65ca7f-eb95-484f-a4b9-db1fed68d2f2 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:06.109284 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1e65ca7f-eb95-484f-a4b9-db1fed68d2f2 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:06.293541 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-1e65ca7f-eb95-484f-a4b9-db1fed68d2f2 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:06.302306 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-1e65ca7f-eb95-484f-a4b9-db1fed68d2f2 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1358 microversion: 2.1 time: 0.210480 Aug 24 03:55:06.302927 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 207/411] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:06 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:06.307213 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-3243368b-f068-4308-a53d-7feccc7e243d req-2fd168fa-06ba-491e-b65f-00b5340ff3ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95c868c4-fc26-429b-8f03-9edf2d7e8a70", "tag": "1d5cfffb-87d1-418d-8955-91c69e97af1e"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:06.321049 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-3243368b-f068-4308-a53d-7feccc7e243d req-2fd168fa-06ba-491e-b65f-00b5340ff3ea service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:06.321688 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-3243368b-f068-4308-a53d-7feccc7e243d req-2fd168fa-06ba-491e-b65f-00b5340ff3ea service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:06.322149 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-3243368b-f068-4308-a53d-7feccc7e243d req-2fd168fa-06ba-491e-b65f-00b5340ff3ea service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:06.334881 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-3243368b-f068-4308-a53d-7feccc7e243d req-2fd168fa-06ba-491e-b65f-00b5340ff3ea service nova] Creating event network-changed:1d5cfffb-87d1-418d-8955-91c69e97af1e for instance 95c868c4-fc26-429b-8f03-9edf2d7e8a70 on hv-cinder-85426 Aug 24 03:55:06.339703 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-3243368b-f068-4308-a53d-7feccc7e243d req-2fd168fa-06ba-491e-b65f-00b5340ff3ea service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035526 Aug 24 03:55:06.340286 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 208/412] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:06.354768 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-f46e08f4-b57e-4bf3-9e62-2d2b15ed47f6 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:06.354768 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-f46e08f4-b57e-4bf3-9e62-2d2b15ed47f6 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:06.354768 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f46e08f4-b57e-4bf3-9e62-2d2b15ed47f6 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:06.354768 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f46e08f4-b57e-4bf3-9e62-2d2b15ed47f6 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:06.355125 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f46e08f4-b57e-4bf3-9e62-2d2b15ed47f6 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:06.355125 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f46e08f4-b57e-4bf3-9e62-2d2b15ed47f6 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:06.355125 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f46e08f4-b57e-4bf3-9e62-2d2b15ed47f6 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:06.355125 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f46e08f4-b57e-4bf3-9e62-2d2b15ed47f6 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:06.359890 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell1:SELECT=100 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:06.535895 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-71434f07-8754-4092-ba58-7d0ca0ac1e85 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "POST /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7/action" status: 202 len: 0 microversion: 2.20 time: 0.668715 Aug 24 03:55:06.536520 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 205/413] 10.222.0.82 () {62 vars in 1319 bytes} [Wed Aug 24 03:55:05 2022] POST /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7/action => generated 0 bytes in 671 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:55:06.545621 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e8e09880-d738-406b-9847-ff63a59914f0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:06.547710 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e8e09880-d738-406b-9847-ff63a59914f0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:06.554200 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8e09880-d738-406b-9847-ff63a59914f0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:06.555029 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8e09880-d738-406b-9847-ff63a59914f0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:06.555582 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8e09880-d738-406b-9847-ff63a59914f0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:06.556410 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8e09880-d738-406b-9847-ff63a59914f0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:06.557019 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8e09880-d738-406b-9847-ff63a59914f0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:06.557533 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8e09880-d738-406b-9847-ff63a59914f0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:06.775336 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-e8e09880-d738-406b-9847-ff63a59914f0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:06.788971 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-e8e09880-d738-406b-9847-ff63a59914f0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:06.790997 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-e8e09880-d738-406b-9847-ff63a59914f0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:06.793403 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e8e09880-d738-406b-9847-ff63a59914f0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1751 microversion: 2.20 time: 0.251990 Aug 24 03:55:06.806769 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 206/414] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:06 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1751 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:55:06.817789 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-443a0bf4-291a-465a-9913-e16a8c19ae17 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:06.818411 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-443a0bf4-291a-465a-9913-e16a8c19ae17 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:06.824608 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-443a0bf4-291a-465a-9913-e16a8c19ae17 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:06.825916 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-443a0bf4-291a-465a-9913-e16a8c19ae17 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:06.825916 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-443a0bf4-291a-465a-9913-e16a8c19ae17 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:06.827614 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-443a0bf4-291a-465a-9913-e16a8c19ae17 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:06.828573 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-443a0bf4-291a-465a-9913-e16a8c19ae17 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:06.829010 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-443a0bf4-291a-465a-9913-e16a8c19ae17 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:06.869629 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-f46e08f4-b57e-4bf3-9e62-2d2b15ed47f6 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:06.880295 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-f46e08f4-b57e-4bf3-9e62-2d2b15ed47f6 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1722 microversion: 2.1 time: 0.538721 Aug 24 03:55:06.881439 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 209/415] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:06 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1722 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:07.019607 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-443a0bf4-291a-465a-9913-e16a8c19ae17 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:07.029143 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-443a0bf4-291a-465a-9913-e16a8c19ae17 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1370 microversion: 2.1 time: 0.220989 Aug 24 03:55:07.029771 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 207/416] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:06 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1370 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:07.077771 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-235d276a-28cf-488d-87d7-d24e6ac7028b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:07.078304 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-235d276a-28cf-488d-87d7-d24e6ac7028b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: b7890971-d4d3-4a0e-bc58-b428eb8c5f0e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:07.085457 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-235d276a-28cf-488d-87d7-d24e6ac7028b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:07.086251 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-235d276a-28cf-488d-87d7-d24e6ac7028b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:07.086880 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-235d276a-28cf-488d-87d7-d24e6ac7028b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:07.087843 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-235d276a-28cf-488d-87d7-d24e6ac7028b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:07.088520 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-235d276a-28cf-488d-87d7-d24e6ac7028b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:07.089123 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-235d276a-28cf-488d-87d7-d24e6ac7028b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:07.324438 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a364eebe-0278-47a0-80ed-18c09f49dd5d tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:07.325150 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a364eebe-0278-47a0-80ed-18c09f49dd5d tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:07.335084 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a364eebe-0278-47a0-80ed-18c09f49dd5d tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:07.336517 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a364eebe-0278-47a0-80ed-18c09f49dd5d tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:07.337568 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a364eebe-0278-47a0-80ed-18c09f49dd5d tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:07.338610 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a364eebe-0278-47a0-80ed-18c09f49dd5d tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:07.339867 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a364eebe-0278-47a0-80ed-18c09f49dd5d tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:07.340447 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a364eebe-0278-47a0-80ed-18c09f49dd5d tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:07.353957 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-235d276a-28cf-488d-87d7-d24e6ac7028b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:07.370266 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-235d276a-28cf-488d-87d7-d24e6ac7028b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e" status: 200 len: 1367 microversion: 2.1 time: 0.296954 Aug 24 03:55:07.371053 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 210/417] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:07 2022] GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e => generated 1367 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:07.539584 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-a364eebe-0278-47a0-80ed-18c09f49dd5d tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:07.552917 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a364eebe-0278-47a0-80ed-18c09f49dd5d tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1358 microversion: 2.1 time: 0.233375 Aug 24 03:55:07.554189 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 208/418] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:07 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1358 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:55:07.822989 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-a33a5fe7-adc2-4ebc-97ae-4eced0defe44 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:07.823863 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-a33a5fe7-adc2-4ebc-97ae-4eced0defe44 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:07.830421 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a33a5fe7-adc2-4ebc-97ae-4eced0defe44 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:07.831100 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a33a5fe7-adc2-4ebc-97ae-4eced0defe44 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:07.831701 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a33a5fe7-adc2-4ebc-97ae-4eced0defe44 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:07.832556 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a33a5fe7-adc2-4ebc-97ae-4eced0defe44 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:07.833162 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a33a5fe7-adc2-4ebc-97ae-4eced0defe44 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:07.833581 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a33a5fe7-adc2-4ebc-97ae-4eced0defe44 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:07.903413 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-81a8a6d1-45d2-4226-8b9c-dc2f40713392 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:07.904170 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-81a8a6d1-45d2-4226-8b9c-dc2f40713392 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:07.908950 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:07.914314 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81a8a6d1-45d2-4226-8b9c-dc2f40713392 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:07.914839 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81a8a6d1-45d2-4226-8b9c-dc2f40713392 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:07.915918 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81a8a6d1-45d2-4226-8b9c-dc2f40713392 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:07.916726 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81a8a6d1-45d2-4226-8b9c-dc2f40713392 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:07.917692 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81a8a6d1-45d2-4226-8b9c-dc2f40713392 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:07.917839 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81a8a6d1-45d2-4226-8b9c-dc2f40713392 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:08.009567 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-a33a5fe7-adc2-4ebc-97ae-4eced0defe44 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:08.030220 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-a33a5fe7-adc2-4ebc-97ae-4eced0defe44 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:08.030220 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-a33a5fe7-adc2-4ebc-97ae-4eced0defe44 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:08.030220 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-a33a5fe7-adc2-4ebc-97ae-4eced0defe44 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1751 microversion: 2.20 time: 0.209633 Aug 24 03:55:08.038866 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 211/419] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:07 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1751 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:08.051173 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-957facfd-19c3-48ac-94d8-405a1ca1c820 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:08.052239 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-957facfd-19c3-48ac-94d8-405a1ca1c820 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:08.059775 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-957facfd-19c3-48ac-94d8-405a1ca1c820 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:08.060181 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-957facfd-19c3-48ac-94d8-405a1ca1c820 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:08.065835 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-957facfd-19c3-48ac-94d8-405a1ca1c820 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:08.065835 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-957facfd-19c3-48ac-94d8-405a1ca1c820 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:08.065835 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-957facfd-19c3-48ac-94d8-405a1ca1c820 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:08.065835 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-957facfd-19c3-48ac-94d8-405a1ca1c820 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:08.090773 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-81a8a6d1-45d2-4226-8b9c-dc2f40713392 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:08.114620 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-81a8a6d1-45d2-4226-8b9c-dc2f40713392 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1722 microversion: 2.1 time: 0.201587 Aug 24 03:55:08.114620 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 209/420] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:07 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1722 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:55:08.208449 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-957facfd-19c3-48ac-94d8-405a1ca1c820 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:08.216294 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-957facfd-19c3-48ac-94d8-405a1ca1c820 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1370 microversion: 2.1 time: 0.169341 Aug 24 03:55:08.216992 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 212/421] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:08 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1370 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:08.393506 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0cf249fb-7365-4c0e-ab0f-3d27268bc804 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:08.394357 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0cf249fb-7365-4c0e-ab0f-3d27268bc804 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: b7890971-d4d3-4a0e-bc58-b428eb8c5f0e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:08.401486 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0cf249fb-7365-4c0e-ab0f-3d27268bc804 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:08.401983 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0cf249fb-7365-4c0e-ab0f-3d27268bc804 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:08.402426 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0cf249fb-7365-4c0e-ab0f-3d27268bc804 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:08.403165 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0cf249fb-7365-4c0e-ab0f-3d27268bc804 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:08.403776 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0cf249fb-7365-4c0e-ab0f-3d27268bc804 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:08.404206 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0cf249fb-7365-4c0e-ab0f-3d27268bc804 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:08.580699 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-99951edd-5331-4015-bb76-5d188db1db11 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:08.584756 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-99951edd-5331-4015-bb76-5d188db1db11 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:08.592075 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-99951edd-5331-4015-bb76-5d188db1db11 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:08.592705 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-99951edd-5331-4015-bb76-5d188db1db11 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:08.593279 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-99951edd-5331-4015-bb76-5d188db1db11 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:08.594207 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-99951edd-5331-4015-bb76-5d188db1db11 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:08.594927 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-99951edd-5331-4015-bb76-5d188db1db11 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:08.596332 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-99951edd-5331-4015-bb76-5d188db1db11 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:08.665757 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-0cf249fb-7365-4c0e-ab0f-3d27268bc804 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:08.667730 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0cf249fb-7365-4c0e-ab0f-3d27268bc804 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e" status: 200 len: 1367 microversion: 2.1 time: 0.278833 Aug 24 03:55:08.668818 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 210/422] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:08 2022] GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e => generated 1367 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:08.862276 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-99951edd-5331-4015-bb76-5d188db1db11 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:08.870348 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-99951edd-5331-4015-bb76-5d188db1db11 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1548 microversion: 2.1 time: 0.298424 Aug 24 03:55:08.871002 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 213/423] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:08 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1548 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:08.893541 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1ee86a1b-bff2-4c97-88d6-83f50a3f7a38 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:08.894277 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1ee86a1b-bff2-4c97-88d6-83f50a3f7a38 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:08.901168 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1ee86a1b-bff2-4c97-88d6-83f50a3f7a38 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:08.907835 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1ee86a1b-bff2-4c97-88d6-83f50a3f7a38 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:08.907835 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1ee86a1b-bff2-4c97-88d6-83f50a3f7a38 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:08.907835 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1ee86a1b-bff2-4c97-88d6-83f50a3f7a38 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:08.907835 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1ee86a1b-bff2-4c97-88d6-83f50a3f7a38 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:08.908672 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1ee86a1b-bff2-4c97-88d6-83f50a3f7a38 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:09.054000 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-1ee86a1b-bff2-4c97-88d6-83f50a3f7a38 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:09.054201 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-daf64bba-a275-4eaa-b071-f5cd434e3f80 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:09.054676 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-daf64bba-a275-4eaa-b071-f5cd434e3f80 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:09.061976 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-daf64bba-a275-4eaa-b071-f5cd434e3f80 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:09.062571 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-daf64bba-a275-4eaa-b071-f5cd434e3f80 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:09.063016 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-daf64bba-a275-4eaa-b071-f5cd434e3f80 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:09.064513 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-daf64bba-a275-4eaa-b071-f5cd434e3f80 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:09.064513 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-daf64bba-a275-4eaa-b071-f5cd434e3f80 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:09.064703 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-daf64bba-a275-4eaa-b071-f5cd434e3f80 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:09.065161 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1ee86a1b-bff2-4c97-88d6-83f50a3f7a38 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1548 microversion: 2.1 time: 0.175675 Aug 24 03:55:09.065746 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 211/424] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:08 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1548 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:09.089048 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f958666f-a14a-45d8-bf98-b312323534b7 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:09.094114 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-f958666f-a14a-45d8-bf98-b312323534b7 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:09.094930 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f958666f-a14a-45d8-bf98-b312323534b7 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Searching by: {'deleted': False, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b'} {{(pid=127870) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:55:09.101855 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f958666f-a14a-45d8-bf98-b312323534b7 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:09.102332 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f958666f-a14a-45d8-bf98-b312323534b7 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:09.102806 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f958666f-a14a-45d8-bf98-b312323534b7 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:09.103526 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f958666f-a14a-45d8-bf98-b312323534b7 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:09.103975 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f958666f-a14a-45d8-bf98-b312323534b7 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:09.104396 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f958666f-a14a-45d8-bf98-b312323534b7 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:09.202479 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.multi_cell_list [None req-f958666f-a14a-45d8-bf98-b312323534b7 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127870) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 03:55:09.205974 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-daf64bba-a275-4eaa-b071-f5cd434e3f80 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:09.215097 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-daf64bba-a275-4eaa-b071-f5cd434e3f80 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:09.217313 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-daf64bba-a275-4eaa-b071-f5cd434e3f80 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:09.218904 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-daf64bba-a275-4eaa-b071-f5cd434e3f80 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1753 microversion: 2.20 time: 0.168529 Aug 24 03:55:09.219111 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 214/425] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:09 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:55:09.223845 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-2d146808-da3a-4355-af75-f3dab171715e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:09.224553 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-2d146808-da3a-4355-af75-f3dab171715e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:09.230976 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2d146808-da3a-4355-af75-f3dab171715e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:09.231683 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2d146808-da3a-4355-af75-f3dab171715e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:09.233101 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2d146808-da3a-4355-af75-f3dab171715e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:09.234290 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2d146808-da3a-4355-af75-f3dab171715e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:09.235072 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2d146808-da3a-4355-af75-f3dab171715e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:09.235512 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2d146808-da3a-4355-af75-f3dab171715e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:09.308908 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f958666f-a14a-45d8-bf98-b312323534b7 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.227100 Aug 24 03:55:09.309492 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 212/426] 10.222.0.82 () {58 vars in 1125 bytes} [Wed Aug 24 03:55:09 2022] GET /compute/v2.1/servers => generated 342 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:55:09.314288 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-63a10321-d44e-498d-96c1-b6bba8c3b4f2 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:09.314927 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-63a10321-d44e-498d-96c1-b6bba8c3b4f2 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:09.321000 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-63a10321-d44e-498d-96c1-b6bba8c3b4f2 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:09.321485 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-63a10321-d44e-498d-96c1-b6bba8c3b4f2 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:09.321917 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-63a10321-d44e-498d-96c1-b6bba8c3b4f2 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:09.322634 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-63a10321-d44e-498d-96c1-b6bba8c3b4f2 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:09.323085 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-63a10321-d44e-498d-96c1-b6bba8c3b4f2 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:09.323659 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-63a10321-d44e-498d-96c1-b6bba8c3b4f2 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:09.383530 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-2d146808-da3a-4355-af75-f3dab171715e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:09.395249 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-2d146808-da3a-4355-af75-f3dab171715e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1722 microversion: 2.1 time: 0.174927 Aug 24 03:55:09.395965 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 215/427] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:09 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:09.414566 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-265a3fea-fdd0-4e76-ab76-a4c90a8e63b5 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:09.416434 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-265a3fea-fdd0-4e76-ab76-a4c90a8e63b5 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:09.425591 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-265a3fea-fdd0-4e76-ab76-a4c90a8e63b5 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:09.426081 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-265a3fea-fdd0-4e76-ab76-a4c90a8e63b5 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:09.426532 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-265a3fea-fdd0-4e76-ab76-a4c90a8e63b5 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:09.431871 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-265a3fea-fdd0-4e76-ab76-a4c90a8e63b5 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:09.432570 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-265a3fea-fdd0-4e76-ab76-a4c90a8e63b5 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:09.433174 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-265a3fea-fdd0-4e76-ab76-a4c90a8e63b5 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:09.474717 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-63a10321-d44e-498d-96c1-b6bba8c3b4f2 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:09.483134 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-63a10321-d44e-498d-96c1-b6bba8c3b4f2 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1370 microversion: 2.1 time: 0.172056 Aug 24 03:55:09.484455 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 213/428] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:09 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:09.575905 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-265a3fea-fdd0-4e76-ab76-a4c90a8e63b5 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:09.584317 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-265a3fea-fdd0-4e76-ab76-a4c90a8e63b5 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1548 microversion: 2.1 time: 0.187145 Aug 24 03:55:09.584955 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 216/429] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:09 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1548 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:09.666906 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-79df583c-289b-45df-8cf2-fcb988b201b5 req-e6327f15-f791-4f08-aa32-c6a6e511ca27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7890971-d4d3-4a0e-bc58-b428eb8c5f0e", "name": "network-vif-plugged", "status": "completed", "tag": "898dcdfe-5a41-42a9-ab1f-09c5ef9e676b"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:09.676998 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-79df583c-289b-45df-8cf2-fcb988b201b5 req-e6327f15-f791-4f08-aa32-c6a6e511ca27 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:09.677478 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-79df583c-289b-45df-8cf2-fcb988b201b5 req-e6327f15-f791-4f08-aa32-c6a6e511ca27 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:09.677904 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-79df583c-289b-45df-8cf2-fcb988b201b5 req-e6327f15-f791-4f08-aa32-c6a6e511ca27 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:09.691903 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-79df583c-289b-45df-8cf2-fcb988b201b5 req-e6327f15-f791-4f08-aa32-c6a6e511ca27 service nova] Creating event network-vif-plugged:898dcdfe-5a41-42a9-ab1f-09c5ef9e676b for instance b7890971-d4d3-4a0e-bc58-b428eb8c5f0e on hv-cinder-85426 Aug 24 03:55:09.692646 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-2b6d79cc-41c1-495e-b245-8f66feb84f7d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:09.694316 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-2b6d79cc-41c1-495e-b245-8f66feb84f7d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: b7890971-d4d3-4a0e-bc58-b428eb8c5f0e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:09.698727 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-79df583c-289b-45df-8cf2-fcb988b201b5 req-e6327f15-f791-4f08-aa32-c6a6e511ca27 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034396 Aug 24 03:55:09.699955 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 214/430] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:09.705224 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:09.707130 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2b6d79cc-41c1-495e-b245-8f66feb84f7d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:09.708324 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2b6d79cc-41c1-495e-b245-8f66feb84f7d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:09.708779 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2b6d79cc-41c1-495e-b245-8f66feb84f7d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:09.709549 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2b6d79cc-41c1-495e-b245-8f66feb84f7d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:09.710032 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2b6d79cc-41c1-495e-b245-8f66feb84f7d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:09.710451 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2b6d79cc-41c1-495e-b245-8f66feb84f7d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:09.859124 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-2b6d79cc-41c1-495e-b245-8f66feb84f7d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:09.868423 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-2b6d79cc-41c1-495e-b245-8f66feb84f7d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e" status: 200 len: 1367 microversion: 2.1 time: 0.182319 Aug 24 03:55:09.869019 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 217/431] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:09 2022] GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:10.244596 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5fdeb49d-d4e3-4316-9247-dafdd6e322e5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:10.245454 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5fdeb49d-d4e3-4316-9247-dafdd6e322e5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:10.254105 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5fdeb49d-d4e3-4316-9247-dafdd6e322e5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:10.256732 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5fdeb49d-d4e3-4316-9247-dafdd6e322e5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:10.257232 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5fdeb49d-d4e3-4316-9247-dafdd6e322e5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:10.257959 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5fdeb49d-d4e3-4316-9247-dafdd6e322e5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:10.258411 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5fdeb49d-d4e3-4316-9247-dafdd6e322e5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:10.259494 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5fdeb49d-d4e3-4316-9247-dafdd6e322e5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:10.423154 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-1fda31e4-5ada-453e-95f5-880e21fa0b4d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:10.424108 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-1fda31e4-5ada-453e-95f5-880e21fa0b4d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:10.428469 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-5fdeb49d-d4e3-4316-9247-dafdd6e322e5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:10.432121 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1fda31e4-5ada-453e-95f5-880e21fa0b4d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:10.432609 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1fda31e4-5ada-453e-95f5-880e21fa0b4d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:10.433212 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1fda31e4-5ada-453e-95f5-880e21fa0b4d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:10.433898 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1fda31e4-5ada-453e-95f5-880e21fa0b4d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:10.434486 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1fda31e4-5ada-453e-95f5-880e21fa0b4d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:10.435076 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1fda31e4-5ada-453e-95f5-880e21fa0b4d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:10.441287 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-5fdeb49d-d4e3-4316-9247-dafdd6e322e5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:10.443499 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-5fdeb49d-d4e3-4316-9247-dafdd6e322e5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:10.444831 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5fdeb49d-d4e3-4316-9247-dafdd6e322e5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1753 microversion: 2.20 time: 0.204919 Aug 24 03:55:10.446960 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 215/432] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:10 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1753 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:10.508085 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6871d323-dd5e-430d-a9c2-be93f1b8bb02 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:10.509431 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6871d323-dd5e-430d-a9c2-be93f1b8bb02 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:10.519679 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6871d323-dd5e-430d-a9c2-be93f1b8bb02 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:10.520541 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6871d323-dd5e-430d-a9c2-be93f1b8bb02 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:10.521273 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6871d323-dd5e-430d-a9c2-be93f1b8bb02 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:10.521990 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6871d323-dd5e-430d-a9c2-be93f1b8bb02 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:10.522470 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6871d323-dd5e-430d-a9c2-be93f1b8bb02 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:10.522916 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6871d323-dd5e-430d-a9c2-be93f1b8bb02 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:10.606976 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-1fda31e4-5ada-453e-95f5-880e21fa0b4d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:10.622582 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-1fda31e4-5ada-453e-95f5-880e21fa0b4d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1722 microversion: 2.1 time: 0.201540 Aug 24 03:55:10.622884 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 218/433] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:10 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:55:10.708178 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-6871d323-dd5e-430d-a9c2-be93f1b8bb02 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:10.716287 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6871d323-dd5e-430d-a9c2-be93f1b8bb02 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1370 microversion: 2.1 time: 0.214674 Aug 24 03:55:10.717359 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 216/434] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:10 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1370 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:55:10.889477 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-1f92a1e5-3b52-4d01-a48f-0d247fc1e67b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:10.890385 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-1f92a1e5-3b52-4d01-a48f-0d247fc1e67b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: b7890971-d4d3-4a0e-bc58-b428eb8c5f0e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:10.898417 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1f92a1e5-3b52-4d01-a48f-0d247fc1e67b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:10.899589 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1f92a1e5-3b52-4d01-a48f-0d247fc1e67b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:10.899589 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1f92a1e5-3b52-4d01-a48f-0d247fc1e67b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:10.900048 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1f92a1e5-3b52-4d01-a48f-0d247fc1e67b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:10.900526 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1f92a1e5-3b52-4d01-a48f-0d247fc1e67b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:10.902212 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1f92a1e5-3b52-4d01-a48f-0d247fc1e67b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:11.139743 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-1f92a1e5-3b52-4d01-a48f-0d247fc1e67b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:11.148161 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-1f92a1e5-3b52-4d01-a48f-0d247fc1e67b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e" status: 200 len: 1367 microversion: 2.1 time: 0.262809 Aug 24 03:55:11.148817 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 219/435] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:10 2022] GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e => generated 1367 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:11.469008 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c0f6b6be-a1c2-4c91-94c1-ca8124c47980 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:11.469750 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c0f6b6be-a1c2-4c91-94c1-ca8124c47980 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:11.480369 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c0f6b6be-a1c2-4c91-94c1-ca8124c47980 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:11.480369 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c0f6b6be-a1c2-4c91-94c1-ca8124c47980 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:11.480369 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c0f6b6be-a1c2-4c91-94c1-ca8124c47980 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:11.480369 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c0f6b6be-a1c2-4c91-94c1-ca8124c47980 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:11.480736 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c0f6b6be-a1c2-4c91-94c1-ca8124c47980 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:11.480736 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c0f6b6be-a1c2-4c91-94c1-ca8124c47980 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:11.543302 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-93004b06-66a2-404d-bbee-56e4437f644a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d76f6f0f-75a1-4ec7-93f7-c54c0f2e2fb4"}} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:11.546171 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-93004b06-66a2-404d-bbee-56e4437f644a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:11.552702 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-93004b06-66a2-404d-bbee-56e4437f644a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:11.553177 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-93004b06-66a2-404d-bbee-56e4437f644a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:11.553761 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-93004b06-66a2-404d-bbee-56e4437f644a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:11.555574 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-93004b06-66a2-404d-bbee-56e4437f644a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:11.555574 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-93004b06-66a2-404d-bbee-56e4437f644a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:11.555574 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-93004b06-66a2-404d-bbee-56e4437f644a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:11.626631 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-c0f6b6be-a1c2-4c91-94c1-ca8124c47980 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:11.637849 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-c0f6b6be-a1c2-4c91-94c1-ca8124c47980 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:11.637849 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-c0f6b6be-a1c2-4c91-94c1-ca8124c47980 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:11.639067 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c0f6b6be-a1c2-4c91-94c1-ca8124c47980 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1753 microversion: 2.20 time: 0.173611 Aug 24 03:55:11.640199 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 217/436] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:11 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1753 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:11.645003 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ba26ffca-1a19-41c9-adba-6e93c87f7061 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:11.645826 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ba26ffca-1a19-41c9-adba-6e93c87f7061 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:11.651924 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba26ffca-1a19-41c9-adba-6e93c87f7061 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:11.652588 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba26ffca-1a19-41c9-adba-6e93c87f7061 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:11.653267 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba26ffca-1a19-41c9-adba-6e93c87f7061 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:11.653984 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba26ffca-1a19-41c9-adba-6e93c87f7061 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:11.654602 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba26ffca-1a19-41c9-adba-6e93c87f7061 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:11.655417 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba26ffca-1a19-41c9-adba-6e93c87f7061 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:11.800157 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-ba26ffca-1a19-41c9-adba-6e93c87f7061 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:11.808370 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ba26ffca-1a19-41c9-adba-6e93c87f7061 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1699 microversion: 2.1 time: 0.167008 Aug 24 03:55:11.808995 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 218/437] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:11 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1699 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:11.814431 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-62e426c6-1384-4f21-bf9e-27034e97130d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:11.815149 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-62e426c6-1384-4f21-bf9e-27034e97130d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:11.821144 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62e426c6-1384-4f21-bf9e-27034e97130d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:11.821627 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62e426c6-1384-4f21-bf9e-27034e97130d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:11.822065 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62e426c6-1384-4f21-bf9e-27034e97130d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:11.837513 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62e426c6-1384-4f21-bf9e-27034e97130d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:11.837513 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62e426c6-1384-4f21-bf9e-27034e97130d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:11.837513 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62e426c6-1384-4f21-bf9e-27034e97130d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:11.980740 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-62e426c6-1384-4f21-bf9e-27034e97130d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:11.989182 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-62e426c6-1384-4f21-bf9e-27034e97130d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1370 microversion: 2.1 time: 0.179104 Aug 24 03:55:11.989766 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 219/438] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:11 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1370 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:11.994408 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b517884a-8ce7-4791-b229-22c0c3c21c2d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:12.001382 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b517884a-8ce7-4791-b229-22c0c3c21c2d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:12.001871 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b517884a-8ce7-4791-b229-22c0c3c21c2d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:12.002310 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b517884a-8ce7-4791-b229-22c0c3c21c2d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:12.033937 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b517884a-8ce7-4791-b229-22c0c3c21c2d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Going to try to start instance {{(pid=127870) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 03:55:12.058543 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:12.792978 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b517884a-8ce7-4791-b229-22c0c3c21c2d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "POST /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6/action" status: 202 len: 0 microversion: 2.1 time: 0.801128 Aug 24 03:55:12.797770 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 220/439] 10.222.0.82 () {60 vars in 1278 bytes} [Wed Aug 24 03:55:11 2022] POST /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6/action => generated 0 bytes in 803 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:55:12.801393 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-aa35f3b1-de1a-4239-a624-9c6f9740e8f5 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:12.802117 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-aa35f3b1-de1a-4239-a624-9c6f9740e8f5 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: b7890971-d4d3-4a0e-bc58-b428eb8c5f0e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:12.814670 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aa35f3b1-de1a-4239-a624-9c6f9740e8f5 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:12.815534 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aa35f3b1-de1a-4239-a624-9c6f9740e8f5 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:12.816639 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aa35f3b1-de1a-4239-a624-9c6f9740e8f5 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:12.817957 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aa35f3b1-de1a-4239-a624-9c6f9740e8f5 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:12.818697 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aa35f3b1-de1a-4239-a624-9c6f9740e8f5 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:12.819416 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aa35f3b1-de1a-4239-a624-9c6f9740e8f5 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:12.981298 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-aa35f3b1-de1a-4239-a624-9c6f9740e8f5 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:12.993570 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-aa35f3b1-de1a-4239-a624-9c6f9740e8f5 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e" status: 200 len: 1367 microversion: 2.1 time: 0.197612 Aug 24 03:55:12.994423 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 221/440] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:12 2022] GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:12.998953 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ede0a616-ff6a-4d32-ab82-3cce7d342a8e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:12.999555 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ede0a616-ff6a-4d32-ab82-3cce7d342a8e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:13.009069 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ede0a616-ff6a-4d32-ab82-3cce7d342a8e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:13.009553 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ede0a616-ff6a-4d32-ab82-3cce7d342a8e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:13.009987 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ede0a616-ff6a-4d32-ab82-3cce7d342a8e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:13.010746 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ede0a616-ff6a-4d32-ab82-3cce7d342a8e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:13.012074 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ede0a616-ff6a-4d32-ab82-3cce7d342a8e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:13.012074 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ede0a616-ff6a-4d32-ab82-3cce7d342a8e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:13.165501 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-ede0a616-ff6a-4d32-ab82-3cce7d342a8e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:13.176239 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-ede0a616-ff6a-4d32-ab82-3cce7d342a8e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:13.177774 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-ede0a616-ff6a-4d32-ab82-3cce7d342a8e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:13.178996 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ede0a616-ff6a-4d32-ab82-3cce7d342a8e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1753 microversion: 2.20 time: 0.183823 Aug 24 03:55:13.179555 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 222/441] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:12 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1753 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:13.184224 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d01d8bb9-709c-4775-8bc5-d28032356f05 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:13.184819 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d01d8bb9-709c-4775-8bc5-d28032356f05 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:13.191040 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d01d8bb9-709c-4775-8bc5-d28032356f05 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:13.191520 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d01d8bb9-709c-4775-8bc5-d28032356f05 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:13.192111 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d01d8bb9-709c-4775-8bc5-d28032356f05 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:13.192812 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d01d8bb9-709c-4775-8bc5-d28032356f05 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:13.193264 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d01d8bb9-709c-4775-8bc5-d28032356f05 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:13.193682 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d01d8bb9-709c-4775-8bc5-d28032356f05 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:13.335519 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-d01d8bb9-709c-4775-8bc5-d28032356f05 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:13.355790 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d01d8bb9-709c-4775-8bc5-d28032356f05 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1708 microversion: 2.1 time: 0.174736 Aug 24 03:55:13.357415 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 223/442] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:13 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1708 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:13.362340 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a8a7cbe8-bde9-45d3-b040-22769f24b1e0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:13.363158 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a8a7cbe8-bde9-45d3-b040-22769f24b1e0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:13.371799 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8a7cbe8-bde9-45d3-b040-22769f24b1e0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:13.372418 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8a7cbe8-bde9-45d3-b040-22769f24b1e0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:13.373164 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8a7cbe8-bde9-45d3-b040-22769f24b1e0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:13.374064 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8a7cbe8-bde9-45d3-b040-22769f24b1e0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:13.374759 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8a7cbe8-bde9-45d3-b040-22769f24b1e0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:13.375278 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8a7cbe8-bde9-45d3-b040-22769f24b1e0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:13.552679 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-a8a7cbe8-bde9-45d3-b040-22769f24b1e0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:13.573014 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a8a7cbe8-bde9-45d3-b040-22769f24b1e0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1370 microversion: 2.1 time: 0.215360 Aug 24 03:55:13.573794 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 224/443] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:13 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1370 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:14.016925 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cf19e1fc-7bb6-4c4c-a3ab-fd43e7cd1cc7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:14.017681 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cf19e1fc-7bb6-4c4c-a3ab-fd43e7cd1cc7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: b7890971-d4d3-4a0e-bc58-b428eb8c5f0e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:14.024235 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf19e1fc-7bb6-4c4c-a3ab-fd43e7cd1cc7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:14.024727 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf19e1fc-7bb6-4c4c-a3ab-fd43e7cd1cc7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:14.025170 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf19e1fc-7bb6-4c4c-a3ab-fd43e7cd1cc7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:14.025923 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf19e1fc-7bb6-4c4c-a3ab-fd43e7cd1cc7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:14.026393 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf19e1fc-7bb6-4c4c-a3ab-fd43e7cd1cc7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:14.026939 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf19e1fc-7bb6-4c4c-a3ab-fd43e7cd1cc7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:14.064970 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-93004b06-66a2-404d-bbee-56e4437f644a tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "POST /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.525436 Aug 24 03:55:14.074223 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 220/444] 10.222.0.82 () {60 vars in 1323 bytes} [Wed Aug 24 03:55:11 2022] POST /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7/os-volume_attachments => generated 194 bytes in 2535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:55:14.083483 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-22e5e57c-4ec9-4c4c-b2dd-57e24b2d8236 req-d55f5ea1-3365-4579-863e-f311e90a28e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95c868c4-fc26-429b-8f03-9edf2d7e8a70", "name": "network-vif-plugged", "status": "completed", "tag": "1d5cfffb-87d1-418d-8955-91c69e97af1e"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:14.095948 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-22e5e57c-4ec9-4c4c-b2dd-57e24b2d8236 req-d55f5ea1-3365-4579-863e-f311e90a28e3 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:14.096594 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-22e5e57c-4ec9-4c4c-b2dd-57e24b2d8236 req-d55f5ea1-3365-4579-863e-f311e90a28e3 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:14.097175 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-22e5e57c-4ec9-4c4c-b2dd-57e24b2d8236 req-d55f5ea1-3365-4579-863e-f311e90a28e3 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:14.115009 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-22e5e57c-4ec9-4c4c-b2dd-57e24b2d8236 req-d55f5ea1-3365-4579-863e-f311e90a28e3 service nova] Creating event network-vif-plugged:1d5cfffb-87d1-418d-8955-91c69e97af1e for instance 95c868c4-fc26-429b-8f03-9edf2d7e8a70 on hv-cinder-85426 Aug 24 03:55:14.121345 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-22e5e57c-4ec9-4c4c-b2dd-57e24b2d8236 req-d55f5ea1-3365-4579-863e-f311e90a28e3 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045239 Aug 24 03:55:14.122255 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 221/445] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:14.187302 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-cf19e1fc-7bb6-4c4c-a3ab-fd43e7cd1cc7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:14.196044 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cf19e1fc-7bb6-4c4c-a3ab-fd43e7cd1cc7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e" status: 200 len: 1558 microversion: 2.1 time: 0.184543 Aug 24 03:55:14.196958 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 225/446] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:14 2022] GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e => generated 1558 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:55:14.206100 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-d4bd7b9c-9f6b-4872-9ea0-eaf8a815113a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:14.208177 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-d4bd7b9c-9f6b-4872-9ea0-eaf8a815113a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:14.219499 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b6c06b47-adf9-4c6b-805b-8bf78ed5656a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:14.219987 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b6c06b47-adf9-4c6b-805b-8bf78ed5656a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: b7890971-d4d3-4a0e-bc58-b428eb8c5f0e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:14.226283 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b6c06b47-adf9-4c6b-805b-8bf78ed5656a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:14.226855 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b6c06b47-adf9-4c6b-805b-8bf78ed5656a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:14.232550 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b6c06b47-adf9-4c6b-805b-8bf78ed5656a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:14.232550 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b6c06b47-adf9-4c6b-805b-8bf78ed5656a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:14.232550 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b6c06b47-adf9-4c6b-805b-8bf78ed5656a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:14.232550 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b6c06b47-adf9-4c6b-805b-8bf78ed5656a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:14.232991 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d4bd7b9c-9f6b-4872-9ea0-eaf8a815113a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:14.232991 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d4bd7b9c-9f6b-4872-9ea0-eaf8a815113a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:14.232991 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d4bd7b9c-9f6b-4872-9ea0-eaf8a815113a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:14.232991 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d4bd7b9c-9f6b-4872-9ea0-eaf8a815113a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:14.233315 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d4bd7b9c-9f6b-4872-9ea0-eaf8a815113a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:14.233315 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d4bd7b9c-9f6b-4872-9ea0-eaf8a815113a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:14.343325 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b6c06b47-adf9-4c6b-805b-8bf78ed5656a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.129407 Aug 24 03:55:14.344970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 226/447] 10.222.0.82 () {58 vars in 1275 bytes} [Wed Aug 24 03:55:14 2022] GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e/os-interface => generated 285 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:55:14.378742 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ffc6a543-a4a6-41b8-92e7-b5b04fa9f05b tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:14.379448 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ffc6a543-a4a6-41b8-92e7-b5b04fa9f05b tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:14.388096 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ffc6a543-a4a6-41b8-92e7-b5b04fa9f05b tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:14.388878 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ffc6a543-a4a6-41b8-92e7-b5b04fa9f05b tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:14.390002 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ffc6a543-a4a6-41b8-92e7-b5b04fa9f05b tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:14.391218 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ffc6a543-a4a6-41b8-92e7-b5b04fa9f05b tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:14.397172 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ffc6a543-a4a6-41b8-92e7-b5b04fa9f05b tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:14.397172 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ffc6a543-a4a6-41b8-92e7-b5b04fa9f05b tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:14.431152 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-d4bd7b9c-9f6b-4872-9ea0-eaf8a815113a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:14.441956 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-d4bd7b9c-9f6b-4872-9ea0-eaf8a815113a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:14.444227 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-d4bd7b9c-9f6b-4872-9ea0-eaf8a815113a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:14.457210 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-d4bd7b9c-9f6b-4872-9ea0-eaf8a815113a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1809 microversion: 2.20 time: 0.258785 Aug 24 03:55:14.458117 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 222/448] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:14 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1809 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:14.596087 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-586459ce-f7fc-4577-9179-d9b2acc80336 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:14.596286 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-586459ce-f7fc-4577-9179-d9b2acc80336 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:14.604818 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-586459ce-f7fc-4577-9179-d9b2acc80336 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:14.605321 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-586459ce-f7fc-4577-9179-d9b2acc80336 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:14.605776 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-586459ce-f7fc-4577-9179-d9b2acc80336 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:14.606457 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-586459ce-f7fc-4577-9179-d9b2acc80336 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:14.607538 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-586459ce-f7fc-4577-9179-d9b2acc80336 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:14.607972 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-586459ce-f7fc-4577-9179-d9b2acc80336 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:14.637000 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-ffc6a543-a4a6-41b8-92e7-b5b04fa9f05b tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:14.646700 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ffc6a543-a4a6-41b8-92e7-b5b04fa9f05b tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1708 microversion: 2.1 time: 0.271578 Aug 24 03:55:14.659684 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 227/449] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:14 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1708 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:14.925031 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-586459ce-f7fc-4577-9179-d9b2acc80336 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:14.932982 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-586459ce-f7fc-4577-9179-d9b2acc80336 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1370 microversion: 2.1 time: 0.343536 Aug 24 03:55:14.933454 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 223/450] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:14 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1370 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:55:15.485806 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-28d215e8-2115-497b-9419-eb8fca1e5a98 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:15.486328 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-28d215e8-2115-497b-9419-eb8fca1e5a98 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:15.493357 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-28d215e8-2115-497b-9419-eb8fca1e5a98 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:15.493935 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-28d215e8-2115-497b-9419-eb8fca1e5a98 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:15.494448 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-28d215e8-2115-497b-9419-eb8fca1e5a98 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:15.495426 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-28d215e8-2115-497b-9419-eb8fca1e5a98 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:15.506895 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-28d215e8-2115-497b-9419-eb8fca1e5a98 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:15.506895 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-28d215e8-2115-497b-9419-eb8fca1e5a98 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:15.667872 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-28d215e8-2115-497b-9419-eb8fca1e5a98 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:15.670483 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-4d1f99e4-b872-4692-bd8e-d39b29ff75cf tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:15.671504 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-4d1f99e4-b872-4692-bd8e-d39b29ff75cf tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:15.678471 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4d1f99e4-b872-4692-bd8e-d39b29ff75cf tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:15.679057 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4d1f99e4-b872-4692-bd8e-d39b29ff75cf tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:15.679563 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4d1f99e4-b872-4692-bd8e-d39b29ff75cf tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:15.679762 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-28d215e8-2115-497b-9419-eb8fca1e5a98 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:15.680397 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4d1f99e4-b872-4692-bd8e-d39b29ff75cf tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:15.680935 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4d1f99e4-b872-4692-bd8e-d39b29ff75cf tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:15.681431 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4d1f99e4-b872-4692-bd8e-d39b29ff75cf tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:15.682159 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-28d215e8-2115-497b-9419-eb8fca1e5a98 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:15.684290 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-28d215e8-2115-497b-9419-eb8fca1e5a98 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1809 microversion: 2.20 time: 0.203749 Aug 24 03:55:15.686208 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 228/451] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:15 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1809 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:15.960082 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6d9e41d4-50d0-4742-94da-f94072815197 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:15.960964 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6d9e41d4-50d0-4742-94da-f94072815197 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:15.976728 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-4d1f99e4-b872-4692-bd8e-d39b29ff75cf tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:15.984478 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d9e41d4-50d0-4742-94da-f94072815197 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:15.991238 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-4d1f99e4-b872-4692-bd8e-d39b29ff75cf tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1708 microversion: 2.1 time: 0.325799 Aug 24 03:55:15.991835 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 224/452] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:15 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1708 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:55:15.995135 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d9e41d4-50d0-4742-94da-f94072815197 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:15.995799 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d9e41d4-50d0-4742-94da-f94072815197 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:15.996901 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d9e41d4-50d0-4742-94da-f94072815197 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:15.998394 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d9e41d4-50d0-4742-94da-f94072815197 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:15.999257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d9e41d4-50d0-4742-94da-f94072815197 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:16.024476 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-ce3ba92a-70fa-4d45-85f1-dcc2e6a33949 req-518c28b9-612f-4b00-8286-e3e565defbf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7890971-d4d3-4a0e-bc58-b428eb8c5f0e", "tag": "898dcdfe-5a41-42a9-ab1f-09c5ef9e676b"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:16.038683 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-ce3ba92a-70fa-4d45-85f1-dcc2e6a33949 req-518c28b9-612f-4b00-8286-e3e565defbf4 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:16.039170 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-ce3ba92a-70fa-4d45-85f1-dcc2e6a33949 req-518c28b9-612f-4b00-8286-e3e565defbf4 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:16.040254 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-ce3ba92a-70fa-4d45-85f1-dcc2e6a33949 req-518c28b9-612f-4b00-8286-e3e565defbf4 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:16.055312 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:16.057563 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-ce3ba92a-70fa-4d45-85f1-dcc2e6a33949 req-518c28b9-612f-4b00-8286-e3e565defbf4 service nova] Creating event network-changed:898dcdfe-5a41-42a9-ab1f-09c5ef9e676b for instance b7890971-d4d3-4a0e-bc58-b428eb8c5f0e on hv-cinder-85426 Aug 24 03:55:16.064743 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-ce3ba92a-70fa-4d45-85f1-dcc2e6a33949 req-518c28b9-612f-4b00-8286-e3e565defbf4 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071182 Aug 24 03:55:16.065651 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 225/453] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:16.166172 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-6d9e41d4-50d0-4742-94da-f94072815197 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:16.174570 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6d9e41d4-50d0-4742-94da-f94072815197 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1370 microversion: 2.1 time: 0.220803 Aug 24 03:55:16.175434 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 229/454] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:15 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1370 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:55:16.709061 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-b64346e2-c1b9-46e2-a81f-12b126d29c41 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:16.709759 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-b64346e2-c1b9-46e2-a81f-12b126d29c41 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:16.719465 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b64346e2-c1b9-46e2-a81f-12b126d29c41 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:16.719964 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b64346e2-c1b9-46e2-a81f-12b126d29c41 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:16.720400 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b64346e2-c1b9-46e2-a81f-12b126d29c41 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:16.721108 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b64346e2-c1b9-46e2-a81f-12b126d29c41 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:16.721557 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b64346e2-c1b9-46e2-a81f-12b126d29c41 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:16.721978 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b64346e2-c1b9-46e2-a81f-12b126d29c41 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:17.000804 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-b64346e2-c1b9-46e2-a81f-12b126d29c41 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:17.011977 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-b64346e2-c1b9-46e2-a81f-12b126d29c41 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:17.015770 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-b64346e2-c1b9-46e2-a81f-12b126d29c41 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:17.016837 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ea269033-7351-4e65-9510-5fa1349e11f9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:17.018162 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ea269033-7351-4e65-9510-5fa1349e11f9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:17.018947 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-b64346e2-c1b9-46e2-a81f-12b126d29c41 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1809 microversion: 2.20 time: 0.314065 Aug 24 03:55:17.019534 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 226/455] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:16 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1809 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:17.027048 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea269033-7351-4e65-9510-5fa1349e11f9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:17.027889 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea269033-7351-4e65-9510-5fa1349e11f9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:17.031062 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea269033-7351-4e65-9510-5fa1349e11f9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:17.031062 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea269033-7351-4e65-9510-5fa1349e11f9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:17.031062 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea269033-7351-4e65-9510-5fa1349e11f9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:17.031927 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea269033-7351-4e65-9510-5fa1349e11f9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:17.196393 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-7531b54f-1ed3-448f-bb39-5b73135744ce tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:17.197007 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-7531b54f-1ed3-448f-bb39-5b73135744ce tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:17.203107 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-ea269033-7351-4e65-9510-5fa1349e11f9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:17.203897 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7531b54f-1ed3-448f-bb39-5b73135744ce tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:17.204392 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7531b54f-1ed3-448f-bb39-5b73135744ce tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:17.205014 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7531b54f-1ed3-448f-bb39-5b73135744ce tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:17.205898 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7531b54f-1ed3-448f-bb39-5b73135744ce tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:17.206366 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7531b54f-1ed3-448f-bb39-5b73135744ce tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:17.206818 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7531b54f-1ed3-448f-bb39-5b73135744ce tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:17.212452 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ea269033-7351-4e65-9510-5fa1349e11f9 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1712 microversion: 2.1 time: 0.201268 Aug 24 03:55:17.213231 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 230/456] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:17 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1712 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:55:17.353953 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-7531b54f-1ed3-448f-bb39-5b73135744ce tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:17.363852 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-7531b54f-1ed3-448f-bb39-5b73135744ce tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1370 microversion: 2.1 time: 0.171143 Aug 24 03:55:17.364286 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 227/457] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:17 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:55:18.051162 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-45aff793-0fb5-4ddd-ad30-1ebc8c0544f3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:18.052505 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-45aff793-0fb5-4ddd-ad30-1ebc8c0544f3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:18.061838 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-45aff793-0fb5-4ddd-ad30-1ebc8c0544f3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:18.062329 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-45aff793-0fb5-4ddd-ad30-1ebc8c0544f3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:18.062804 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-45aff793-0fb5-4ddd-ad30-1ebc8c0544f3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:18.063580 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-45aff793-0fb5-4ddd-ad30-1ebc8c0544f3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:18.064040 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-45aff793-0fb5-4ddd-ad30-1ebc8c0544f3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:18.064466 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-45aff793-0fb5-4ddd-ad30-1ebc8c0544f3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:18.307097 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-45aff793-0fb5-4ddd-ad30-1ebc8c0544f3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:18.316288 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-45aff793-0fb5-4ddd-ad30-1ebc8c0544f3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:18.317784 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-45aff793-0fb5-4ddd-ad30-1ebc8c0544f3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:18.318977 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-45aff793-0fb5-4ddd-ad30-1ebc8c0544f3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1809 microversion: 2.20 time: 0.272462 Aug 24 03:55:18.319538 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 231/458] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:18 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1809 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:18.387612 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-d7c340bb-d1cd-4f4e-beb3-c5d939b368f9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:18.389514 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-d7c340bb-d1cd-4f4e-beb3-c5d939b368f9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:18.398167 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d7c340bb-d1cd-4f4e-beb3-c5d939b368f9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:18.401172 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d7c340bb-d1cd-4f4e-beb3-c5d939b368f9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:18.401172 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d7c340bb-d1cd-4f4e-beb3-c5d939b368f9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:18.401172 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d7c340bb-d1cd-4f4e-beb3-c5d939b368f9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:18.401172 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d7c340bb-d1cd-4f4e-beb3-c5d939b368f9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:18.401666 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d7c340bb-d1cd-4f4e-beb3-c5d939b368f9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:18.563294 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-d7c340bb-d1cd-4f4e-beb3-c5d939b368f9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:18.575710 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-d7c340bb-d1cd-4f4e-beb3-c5d939b368f9 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1563 microversion: 2.1 time: 0.191894 Aug 24 03:55:18.576974 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 228/459] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:18 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1563 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:18.599648 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7fac7b63-2e54-4db4-9d26-6a5bef85829c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:18.600188 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7fac7b63-2e54-4db4-9d26-6a5bef85829c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:18.607956 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fac7b63-2e54-4db4-9d26-6a5bef85829c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:18.608549 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fac7b63-2e54-4db4-9d26-6a5bef85829c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:18.608985 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fac7b63-2e54-4db4-9d26-6a5bef85829c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:18.609788 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fac7b63-2e54-4db4-9d26-6a5bef85829c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:18.610297 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fac7b63-2e54-4db4-9d26-6a5bef85829c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:18.610835 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fac7b63-2e54-4db4-9d26-6a5bef85829c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:18.718551 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7fac7b63-2e54-4db4-9d26-6a5bef85829c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.122676 Aug 24 03:55:18.720157 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 232/460] 10.222.0.82 () {58 vars in 1275 bytes} [Wed Aug 24 03:55:18 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:19.342911 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-77917610-3d4d-44f3-b79f-32dd5ac6deac tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:19.343520 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-77917610-3d4d-44f3-b79f-32dd5ac6deac tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:19.357283 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-77917610-3d4d-44f3-b79f-32dd5ac6deac tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:19.357980 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-77917610-3d4d-44f3-b79f-32dd5ac6deac tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:19.358410 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-77917610-3d4d-44f3-b79f-32dd5ac6deac tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:19.370874 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-77917610-3d4d-44f3-b79f-32dd5ac6deac tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:19.371640 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-77917610-3d4d-44f3-b79f-32dd5ac6deac tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:19.373403 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-77917610-3d4d-44f3-b79f-32dd5ac6deac tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:19.699618 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-77917610-3d4d-44f3-b79f-32dd5ac6deac tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:19.711789 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-77917610-3d4d-44f3-b79f-32dd5ac6deac tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:19.713355 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-77917610-3d4d-44f3-b79f-32dd5ac6deac tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:19.715379 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-77917610-3d4d-44f3-b79f-32dd5ac6deac tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1809 microversion: 2.20 time: 0.377001 Aug 24 03:55:19.734287 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 229/461] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:19 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1809 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:20.390134 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:20.401615 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-781e6466-e3db-4186-bf2d-5652873a287e req-d6c20ae2-0ecb-4dea-885b-e6a5db8fd60b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95c868c4-fc26-429b-8f03-9edf2d7e8a70", "tag": "1d5cfffb-87d1-418d-8955-91c69e97af1e"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:20.428247 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-781e6466-e3db-4186-bf2d-5652873a287e req-d6c20ae2-0ecb-4dea-885b-e6a5db8fd60b service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:20.432705 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-781e6466-e3db-4186-bf2d-5652873a287e req-d6c20ae2-0ecb-4dea-885b-e6a5db8fd60b service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:20.434747 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-781e6466-e3db-4186-bf2d-5652873a287e req-d6c20ae2-0ecb-4dea-885b-e6a5db8fd60b service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:20.457889 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-781e6466-e3db-4186-bf2d-5652873a287e req-d6c20ae2-0ecb-4dea-885b-e6a5db8fd60b service nova] Creating event network-changed:1d5cfffb-87d1-418d-8955-91c69e97af1e for instance 95c868c4-fc26-429b-8f03-9edf2d7e8a70 on hv-cinder-85426 Aug 24 03:55:20.464905 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-781e6466-e3db-4186-bf2d-5652873a287e req-d6c20ae2-0ecb-4dea-885b-e6a5db8fd60b service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076091 Aug 24 03:55:20.469194 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 233/462] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:20.741405 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-ad1834af-62a6-403c-9746-d70dba81c943 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:20.741990 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-ad1834af-62a6-403c-9746-d70dba81c943 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:20.753930 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ad1834af-62a6-403c-9746-d70dba81c943 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:20.754854 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ad1834af-62a6-403c-9746-d70dba81c943 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:20.755463 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ad1834af-62a6-403c-9746-d70dba81c943 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:20.756340 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ad1834af-62a6-403c-9746-d70dba81c943 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:20.759081 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ad1834af-62a6-403c-9746-d70dba81c943 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:20.759825 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ad1834af-62a6-403c-9746-d70dba81c943 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:21.034609 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-ad1834af-62a6-403c-9746-d70dba81c943 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:21.046262 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-ad1834af-62a6-403c-9746-d70dba81c943 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:21.048495 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-ad1834af-62a6-403c-9746-d70dba81c943 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:21.049852 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-ad1834af-62a6-403c-9746-d70dba81c943 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1809 microversion: 2.20 time: 0.312512 Aug 24 03:55:21.063358 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 230/463] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:20 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1809 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:22.078668 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c6fbe5a4-e6a1-4164-80f3-7d736181966b tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:22.079579 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c6fbe5a4-e6a1-4164-80f3-7d736181966b tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:22.086773 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c6fbe5a4-e6a1-4164-80f3-7d736181966b tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:22.087297 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c6fbe5a4-e6a1-4164-80f3-7d736181966b tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:22.087738 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c6fbe5a4-e6a1-4164-80f3-7d736181966b tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:22.088454 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c6fbe5a4-e6a1-4164-80f3-7d736181966b tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:22.088913 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c6fbe5a4-e6a1-4164-80f3-7d736181966b tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:22.089367 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c6fbe5a4-e6a1-4164-80f3-7d736181966b tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:22.249895 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-c6fbe5a4-e6a1-4164-80f3-7d736181966b tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:22.269297 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-c6fbe5a4-e6a1-4164-80f3-7d736181966b tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:22.270906 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-c6fbe5a4-e6a1-4164-80f3-7d736181966b tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:22.272111 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c6fbe5a4-e6a1-4164-80f3-7d736181966b tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1809 microversion: 2.20 time: 0.199502 Aug 24 03:55:22.272676 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 234/464] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:22 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1809 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:23.296334 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-4b7f79d9-6cb3-44e9-8f9d-c2027b0cf643 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:23.297781 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-4b7f79d9-6cb3-44e9-8f9d-c2027b0cf643 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:23.304756 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4b7f79d9-6cb3-44e9-8f9d-c2027b0cf643 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:23.305264 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4b7f79d9-6cb3-44e9-8f9d-c2027b0cf643 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:23.305689 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4b7f79d9-6cb3-44e9-8f9d-c2027b0cf643 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:23.306677 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4b7f79d9-6cb3-44e9-8f9d-c2027b0cf643 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:23.307594 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4b7f79d9-6cb3-44e9-8f9d-c2027b0cf643 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:23.308123 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4b7f79d9-6cb3-44e9-8f9d-c2027b0cf643 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:23.738958 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-4b7f79d9-6cb3-44e9-8f9d-c2027b0cf643 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:23.757211 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-4b7f79d9-6cb3-44e9-8f9d-c2027b0cf643 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:23.758749 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-4b7f79d9-6cb3-44e9-8f9d-c2027b0cf643 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:23.759929 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-4b7f79d9-6cb3-44e9-8f9d-c2027b0cf643 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1809 microversion: 2.20 time: 0.468221 Aug 24 03:55:23.760484 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 231/465] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:23 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1809 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:24.788282 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e0def199-a359-4df3-8fe7-19511b04f4cf tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:24.790118 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e0def199-a359-4df3-8fe7-19511b04f4cf tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:24.799670 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e0def199-a359-4df3-8fe7-19511b04f4cf tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:24.800230 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e0def199-a359-4df3-8fe7-19511b04f4cf tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:24.800703 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e0def199-a359-4df3-8fe7-19511b04f4cf tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:24.801493 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e0def199-a359-4df3-8fe7-19511b04f4cf tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:24.801944 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e0def199-a359-4df3-8fe7-19511b04f4cf tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:24.802366 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e0def199-a359-4df3-8fe7-19511b04f4cf tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:24.941496 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-e0def199-a359-4df3-8fe7-19511b04f4cf tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:24.951300 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-e0def199-a359-4df3-8fe7-19511b04f4cf tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:24.952783 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-e0def199-a359-4df3-8fe7-19511b04f4cf tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:24.953926 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e0def199-a359-4df3-8fe7-19511b04f4cf tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1809 microversion: 2.20 time: 0.172587 Aug 24 03:55:24.954486 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 235/466] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:24 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:25.977629 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-8e95236d-3b58-4b61-b425-bc7fe66363df tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:25.978307 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-8e95236d-3b58-4b61-b425-bc7fe66363df tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:25.995564 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8e95236d-3b58-4b61-b425-bc7fe66363df tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:25.995564 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8e95236d-3b58-4b61-b425-bc7fe66363df tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:25.995564 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8e95236d-3b58-4b61-b425-bc7fe66363df tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:25.995564 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8e95236d-3b58-4b61-b425-bc7fe66363df tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:25.997334 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8e95236d-3b58-4b61-b425-bc7fe66363df tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:25.997334 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8e95236d-3b58-4b61-b425-bc7fe66363df tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:26.151030 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-8e95236d-3b58-4b61-b425-bc7fe66363df tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:26.164233 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-8e95236d-3b58-4b61-b425-bc7fe66363df tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:26.169515 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-8e95236d-3b58-4b61-b425-bc7fe66363df tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:26.173787 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-8e95236d-3b58-4b61-b425-bc7fe66363df tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1809 microversion: 2.20 time: 0.197102 Aug 24 03:55:26.187867 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 232/467] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:25 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1809 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:27.198006 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6abad94b-732a-4e98-a6af-ee0b5bef64be tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:27.198635 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6abad94b-732a-4e98-a6af-ee0b5bef64be tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:27.206871 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6abad94b-732a-4e98-a6af-ee0b5bef64be tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:27.207356 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6abad94b-732a-4e98-a6af-ee0b5bef64be tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:27.207847 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6abad94b-732a-4e98-a6af-ee0b5bef64be tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:27.208606 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6abad94b-732a-4e98-a6af-ee0b5bef64be tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:27.209009 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6abad94b-732a-4e98-a6af-ee0b5bef64be tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:27.209466 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6abad94b-732a-4e98-a6af-ee0b5bef64be tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:27.371784 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-6abad94b-732a-4e98-a6af-ee0b5bef64be tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:27.385982 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-6abad94b-732a-4e98-a6af-ee0b5bef64be tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:27.388119 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-6abad94b-732a-4e98-a6af-ee0b5bef64be tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:27.389557 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6abad94b-732a-4e98-a6af-ee0b5bef64be tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1809 microversion: 2.20 time: 0.195599 Aug 24 03:55:27.390120 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 236/468] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:27 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1809 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:28.414379 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-e81ea34e-9f89-4b24-abe7-284e9041b91f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:28.419703 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-e81ea34e-9f89-4b24-abe7-284e9041b91f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:28.427401 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e81ea34e-9f89-4b24-abe7-284e9041b91f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:28.427890 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e81ea34e-9f89-4b24-abe7-284e9041b91f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:28.428324 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e81ea34e-9f89-4b24-abe7-284e9041b91f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:28.429144 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e81ea34e-9f89-4b24-abe7-284e9041b91f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:28.429584 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e81ea34e-9f89-4b24-abe7-284e9041b91f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:28.429974 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e81ea34e-9f89-4b24-abe7-284e9041b91f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:28.598566 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-e81ea34e-9f89-4b24-abe7-284e9041b91f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:28.609155 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-e81ea34e-9f89-4b24-abe7-284e9041b91f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:28.610808 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-e81ea34e-9f89-4b24-abe7-284e9041b91f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:28.612150 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-e81ea34e-9f89-4b24-abe7-284e9041b91f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1809 microversion: 2.20 time: 0.202312 Aug 24 03:55:28.612784 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 233/469] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:28 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1809 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:29.636102 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bca5d618-4829-4efc-a291-7a72b339231e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:29.636687 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bca5d618-4829-4efc-a291-7a72b339231e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:29.643212 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bca5d618-4829-4efc-a291-7a72b339231e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:29.643701 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bca5d618-4829-4efc-a291-7a72b339231e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:29.644138 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bca5d618-4829-4efc-a291-7a72b339231e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:29.644870 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bca5d618-4829-4efc-a291-7a72b339231e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:29.645330 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bca5d618-4829-4efc-a291-7a72b339231e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:29.645786 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bca5d618-4829-4efc-a291-7a72b339231e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:29.781097 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-bca5d618-4829-4efc-a291-7a72b339231e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:29.789898 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-bca5d618-4829-4efc-a291-7a72b339231e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:29.791418 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-bca5d618-4829-4efc-a291-7a72b339231e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:29.793140 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bca5d618-4829-4efc-a291-7a72b339231e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1809 microversion: 2.20 time: 0.160484 Aug 24 03:55:29.793960 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 237/470] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:29 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:30.815565 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-4f3efa37-8eac-4442-8aa8-1ba96675269d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:30.816172 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-4f3efa37-8eac-4442-8aa8-1ba96675269d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:30.822552 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4f3efa37-8eac-4442-8aa8-1ba96675269d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:30.823028 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4f3efa37-8eac-4442-8aa8-1ba96675269d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:30.823456 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4f3efa37-8eac-4442-8aa8-1ba96675269d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:30.824250 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4f3efa37-8eac-4442-8aa8-1ba96675269d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:30.824682 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4f3efa37-8eac-4442-8aa8-1ba96675269d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:30.825099 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4f3efa37-8eac-4442-8aa8-1ba96675269d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:30.955295 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-4f3efa37-8eac-4442-8aa8-1ba96675269d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:30.963741 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-4f3efa37-8eac-4442-8aa8-1ba96675269d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:30.965787 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-4f3efa37-8eac-4442-8aa8-1ba96675269d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:30.966958 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-4f3efa37-8eac-4442-8aa8-1ba96675269d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1809 microversion: 2.20 time: 0.155363 Aug 24 03:55:30.967514 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 234/471] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:30 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:31.989283 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-31313e0d-a858-4608-8f02-34b706ff2d61 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:31.989964 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-31313e0d-a858-4608-8f02-34b706ff2d61 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:31.996546 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-31313e0d-a858-4608-8f02-34b706ff2d61 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:31.997034 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-31313e0d-a858-4608-8f02-34b706ff2d61 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:31.997468 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-31313e0d-a858-4608-8f02-34b706ff2d61 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:31.998172 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-31313e0d-a858-4608-8f02-34b706ff2d61 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:31.998650 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-31313e0d-a858-4608-8f02-34b706ff2d61 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:31.999093 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-31313e0d-a858-4608-8f02-34b706ff2d61 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:32.025259 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:32.142448 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-31313e0d-a858-4608-8f02-34b706ff2d61 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:32.151187 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-31313e0d-a858-4608-8f02-34b706ff2d61 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:32.152815 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-31313e0d-a858-4608-8f02-34b706ff2d61 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:32.154719 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-31313e0d-a858-4608-8f02-34b706ff2d61 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1809 microversion: 2.20 time: 0.169259 Aug 24 03:55:32.155352 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 238/472] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:31 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:32.488697 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-38f19bcc-351c-4372-beaa-333f4b067062 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:32.489323 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-38f19bcc-351c-4372-beaa-333f4b067062 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:32.495701 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-38f19bcc-351c-4372-beaa-333f4b067062 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:32.499843 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-38f19bcc-351c-4372-beaa-333f4b067062 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:32.499843 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-38f19bcc-351c-4372-beaa-333f4b067062 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:32.499843 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-38f19bcc-351c-4372-beaa-333f4b067062 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:32.499843 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-38f19bcc-351c-4372-beaa-333f4b067062 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:32.500829 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-38f19bcc-351c-4372-beaa-333f4b067062 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:32.632629 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-38f19bcc-351c-4372-beaa-333f4b067062 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:32.641503 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-38f19bcc-351c-4372-beaa-333f4b067062 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1594 microversion: 2.1 time: 0.156588 Aug 24 03:55:32.642108 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 235/473] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:32 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1594 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:33.177567 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7fe760e3-6481-4008-9aae-064f86cfdd77 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:33.178170 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7fe760e3-6481-4008-9aae-064f86cfdd77 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:33.185336 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fe760e3-6481-4008-9aae-064f86cfdd77 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:33.185807 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fe760e3-6481-4008-9aae-064f86cfdd77 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:33.186235 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fe760e3-6481-4008-9aae-064f86cfdd77 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:33.186960 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fe760e3-6481-4008-9aae-064f86cfdd77 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:33.187390 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fe760e3-6481-4008-9aae-064f86cfdd77 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:33.187803 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fe760e3-6481-4008-9aae-064f86cfdd77 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:33.331279 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-7fe760e3-6481-4008-9aae-064f86cfdd77 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:33.341498 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-7fe760e3-6481-4008-9aae-064f86cfdd77 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:33.342989 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-7fe760e3-6481-4008-9aae-064f86cfdd77 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:33.344451 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7fe760e3-6481-4008-9aae-064f86cfdd77 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1809 microversion: 2.20 time: 0.170852 Aug 24 03:55:33.345012 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 239/474] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:33 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:34.369110 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-2e8c3f1e-c3fa-4090-9cba-b8112677ac21 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:34.369826 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-2e8c3f1e-c3fa-4090-9cba-b8112677ac21 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:34.378250 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2e8c3f1e-c3fa-4090-9cba-b8112677ac21 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:34.378838 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2e8c3f1e-c3fa-4090-9cba-b8112677ac21 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:34.379422 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2e8c3f1e-c3fa-4090-9cba-b8112677ac21 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:34.380132 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2e8c3f1e-c3fa-4090-9cba-b8112677ac21 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:34.380589 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2e8c3f1e-c3fa-4090-9cba-b8112677ac21 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:34.381061 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2e8c3f1e-c3fa-4090-9cba-b8112677ac21 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:34.580198 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-2e8c3f1e-c3fa-4090-9cba-b8112677ac21 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:34.589250 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-2e8c3f1e-c3fa-4090-9cba-b8112677ac21 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:34.591485 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-2e8c3f1e-c3fa-4090-9cba-b8112677ac21 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:34.592864 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-2e8c3f1e-c3fa-4090-9cba-b8112677ac21 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1809 microversion: 2.20 time: 0.228658 Aug 24 03:55:34.606043 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 236/475] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:34 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1809 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:34.936126 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-7500e16d-8859-4e65-838a-fea01f81b2ef req-9eaaaabf-8376-4ffd-bde3-ffa4cf224d58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0e4f072-3d61-4169-aba1-decacb716ac7", "tag": "1e23267f-b4be-439b-aa5f-3dbc95900806"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:34.948570 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-7500e16d-8859-4e65-838a-fea01f81b2ef req-9eaaaabf-8376-4ffd-bde3-ffa4cf224d58 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:34.949357 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-7500e16d-8859-4e65-838a-fea01f81b2ef req-9eaaaabf-8376-4ffd-bde3-ffa4cf224d58 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:34.950494 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-7500e16d-8859-4e65-838a-fea01f81b2ef req-9eaaaabf-8376-4ffd-bde3-ffa4cf224d58 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:34.964431 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-7500e16d-8859-4e65-838a-fea01f81b2ef req-9eaaaabf-8376-4ffd-bde3-ffa4cf224d58 service nova] Creating event network-changed:1e23267f-b4be-439b-aa5f-3dbc95900806 for instance e0e4f072-3d61-4169-aba1-decacb716ac7 on hv-cinder-85426 Aug 24 03:55:34.971056 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-7500e16d-8859-4e65-838a-fea01f81b2ef req-9eaaaabf-8376-4ffd-bde3-ffa4cf224d58 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038968 Aug 24 03:55:34.972004 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 240/476] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:35.616844 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-cee798a4-690c-40c5-842e-1cb926aaa3d4 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:35.622626 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-cee798a4-690c-40c5-842e-1cb926aaa3d4 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:35.629610 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cee798a4-690c-40c5-842e-1cb926aaa3d4 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:35.630087 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cee798a4-690c-40c5-842e-1cb926aaa3d4 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:35.630711 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cee798a4-690c-40c5-842e-1cb926aaa3d4 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:35.631425 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cee798a4-690c-40c5-842e-1cb926aaa3d4 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:35.632028 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cee798a4-690c-40c5-842e-1cb926aaa3d4 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:35.632591 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cee798a4-690c-40c5-842e-1cb926aaa3d4 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:35.778405 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-cee798a4-690c-40c5-842e-1cb926aaa3d4 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:35.790248 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-cee798a4-690c-40c5-842e-1cb926aaa3d4 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:35.791924 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-cee798a4-690c-40c5-842e-1cb926aaa3d4 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:35.793142 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-cee798a4-690c-40c5-842e-1cb926aaa3d4 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1809 microversion: 2.20 time: 0.180582 Aug 24 03:55:35.794448 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 237/477] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:35 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:36.818526 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f1cdccf5-6a7d-4ed9-9057-eb772d624616 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:36.819280 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f1cdccf5-6a7d-4ed9-9057-eb772d624616 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:36.825634 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1cdccf5-6a7d-4ed9-9057-eb772d624616 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:36.826111 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1cdccf5-6a7d-4ed9-9057-eb772d624616 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:36.826585 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1cdccf5-6a7d-4ed9-9057-eb772d624616 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:36.827275 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1cdccf5-6a7d-4ed9-9057-eb772d624616 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:36.827722 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1cdccf5-6a7d-4ed9-9057-eb772d624616 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:36.828132 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1cdccf5-6a7d-4ed9-9057-eb772d624616 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:36.970107 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-f1cdccf5-6a7d-4ed9-9057-eb772d624616 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:36.979277 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-f1cdccf5-6a7d-4ed9-9057-eb772d624616 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:36.981476 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-f1cdccf5-6a7d-4ed9-9057-eb772d624616 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:36.982718 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f1cdccf5-6a7d-4ed9-9057-eb772d624616 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1809 microversion: 2.20 time: 0.169126 Aug 24 03:55:36.983280 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 241/478] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:36 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:55:37.961959 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-2d415730-3af1-493a-ae96-8b01cdbfc447 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-184954190"}} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:37.966213 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-2d415730-3af1-493a-ae96-8b01cdbfc447 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:37.969706 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2d415730-3af1-493a-ae96-8b01cdbfc447 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:37.970182 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2d415730-3af1-493a-ae96-8b01cdbfc447 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:37.970638 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2d415730-3af1-493a-ae96-8b01cdbfc447 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:37.971317 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2d415730-3af1-493a-ae96-8b01cdbfc447 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:37.971786 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2d415730-3af1-493a-ae96-8b01cdbfc447 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:37.972197 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2d415730-3af1-493a-ae96-8b01cdbfc447 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:38.010306 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-22ca042b-ce2f-48d1-8f06-278aebc57fba tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:38.013958 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-22ca042b-ce2f-48d1-8f06-278aebc57fba tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:38.020961 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22ca042b-ce2f-48d1-8f06-278aebc57fba tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:38.023107 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22ca042b-ce2f-48d1-8f06-278aebc57fba tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:38.023107 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22ca042b-ce2f-48d1-8f06-278aebc57fba tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:38.023107 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22ca042b-ce2f-48d1-8f06-278aebc57fba tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:38.023914 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22ca042b-ce2f-48d1-8f06-278aebc57fba tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:38.023914 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-22ca042b-ce2f-48d1-8f06-278aebc57fba tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:38.108970 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.network.security_group_api [None req-2d415730-3af1-493a-ae96-8b01cdbfc447 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Adding security group 9aa9ac00-7c3d-4bd4-b90c-242a0112acdc to port 1e23267f-b4be-439b-aa5f-3dbc95900806 Aug 24 03:55:38.169114 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-22ca042b-ce2f-48d1-8f06-278aebc57fba tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:38.177948 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-22ca042b-ce2f-48d1-8f06-278aebc57fba tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:38.179495 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-22ca042b-ce2f-48d1-8f06-278aebc57fba tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:38.180648 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-22ca042b-ce2f-48d1-8f06-278aebc57fba tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1809 microversion: 2.20 time: 0.174260 Aug 24 03:55:38.181199 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 242/479] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:38 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:38.529033 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-2d415730-3af1-493a-ae96-8b01cdbfc447 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "POST /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7/action" status: 202 len: 0 microversion: 2.1 time: 0.570467 Aug 24 03:55:38.530055 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 238/480] 10.222.0.82 () {60 vars in 1278 bytes} [Wed Aug 24 03:55:37 2022] POST /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7/action => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:55:38.536419 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-f4f47260-e5b4-4414-9eeb-44f03047f15a req-139182e8-980e-4e71-9667-fd3f93907a01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0e4f072-3d61-4169-aba1-decacb716ac7", "tag": "1e23267f-b4be-439b-aa5f-3dbc95900806"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:38.539996 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-9bfe6f59-f2d0-402b-a7b1-647d9396ee7f tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:38.544601 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-9bfe6f59-f2d0-402b-a7b1-647d9396ee7f tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:38.547663 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9bfe6f59-f2d0-402b-a7b1-647d9396ee7f tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:38.548215 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9bfe6f59-f2d0-402b-a7b1-647d9396ee7f tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:38.548714 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9bfe6f59-f2d0-402b-a7b1-647d9396ee7f tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:38.549468 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9bfe6f59-f2d0-402b-a7b1-647d9396ee7f tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:38.549918 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f4f47260-e5b4-4414-9eeb-44f03047f15a req-139182e8-980e-4e71-9667-fd3f93907a01 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:38.550327 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9bfe6f59-f2d0-402b-a7b1-647d9396ee7f tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:38.550854 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9bfe6f59-f2d0-402b-a7b1-647d9396ee7f tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:38.551052 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f4f47260-e5b4-4414-9eeb-44f03047f15a req-139182e8-980e-4e71-9667-fd3f93907a01 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:38.551725 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-f4f47260-e5b4-4414-9eeb-44f03047f15a req-139182e8-980e-4e71-9667-fd3f93907a01 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:38.566987 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-f4f47260-e5b4-4414-9eeb-44f03047f15a req-139182e8-980e-4e71-9667-fd3f93907a01 service nova] Creating event network-changed:1e23267f-b4be-439b-aa5f-3dbc95900806 for instance e0e4f072-3d61-4169-aba1-decacb716ac7 on hv-cinder-85426 Aug 24 03:55:38.573316 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-f4f47260-e5b4-4414-9eeb-44f03047f15a req-139182e8-980e-4e71-9667-fd3f93907a01 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040348 Aug 24 03:55:38.575449 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 243/481] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:38.729577 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-9bfe6f59-f2d0-402b-a7b1-647d9396ee7f tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:38.739015 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-9bfe6f59-f2d0-402b-a7b1-647d9396ee7f tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1757 microversion: 2.1 time: 0.203732 Aug 24 03:55:38.747944 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 239/482] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:38 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1757 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:55:39.204953 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d433b04b-3cb0-470d-b553-c6c6e32b0302 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:39.205655 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d433b04b-3cb0-470d-b553-c6c6e32b0302 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:39.208076 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=69 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:39.212998 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d433b04b-3cb0-470d-b553-c6c6e32b0302 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:39.213486 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d433b04b-3cb0-470d-b553-c6c6e32b0302 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:39.216490 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d433b04b-3cb0-470d-b553-c6c6e32b0302 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:39.216490 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d433b04b-3cb0-470d-b553-c6c6e32b0302 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:39.216490 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d433b04b-3cb0-470d-b553-c6c6e32b0302 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:39.216800 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d433b04b-3cb0-470d-b553-c6c6e32b0302 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:39.362793 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-d433b04b-3cb0-470d-b553-c6c6e32b0302 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:39.371672 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-d433b04b-3cb0-470d-b553-c6c6e32b0302 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:39.373170 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-d433b04b-3cb0-470d-b553-c6c6e32b0302 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:39.374403 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d433b04b-3cb0-470d-b553-c6c6e32b0302 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1809 microversion: 2.20 time: 0.173737 Aug 24 03:55:39.375010 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 244/483] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:39 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:40.397348 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-7af336cd-c151-49af-b1fc-5bf581114760 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:40.397948 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-7af336cd-c151-49af-b1fc-5bf581114760 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:40.405471 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7af336cd-c151-49af-b1fc-5bf581114760 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:40.405952 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7af336cd-c151-49af-b1fc-5bf581114760 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:40.406388 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7af336cd-c151-49af-b1fc-5bf581114760 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:40.407105 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7af336cd-c151-49af-b1fc-5bf581114760 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:40.407561 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7af336cd-c151-49af-b1fc-5bf581114760 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:40.407988 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7af336cd-c151-49af-b1fc-5bf581114760 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:40.541406 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-7af336cd-c151-49af-b1fc-5bf581114760 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:40.550919 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-7af336cd-c151-49af-b1fc-5bf581114760 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:40.552428 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-7af336cd-c151-49af-b1fc-5bf581114760 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:40.553608 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-7af336cd-c151-49af-b1fc-5bf581114760 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1809 microversion: 2.20 time: 0.160108 Aug 24 03:55:40.554150 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 240/484] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:40 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:41.576847 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fe10d2aa-8b36-4668-ad14-205874b75e7d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:41.577462 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fe10d2aa-8b36-4668-ad14-205874b75e7d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:41.588001 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe10d2aa-8b36-4668-ad14-205874b75e7d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:41.588001 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe10d2aa-8b36-4668-ad14-205874b75e7d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:41.588001 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe10d2aa-8b36-4668-ad14-205874b75e7d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:41.588001 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe10d2aa-8b36-4668-ad14-205874b75e7d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:41.588527 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe10d2aa-8b36-4668-ad14-205874b75e7d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:41.588527 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fe10d2aa-8b36-4668-ad14-205874b75e7d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:41.727303 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-fe10d2aa-8b36-4668-ad14-205874b75e7d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:41.737465 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-fe10d2aa-8b36-4668-ad14-205874b75e7d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:41.740187 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-fe10d2aa-8b36-4668-ad14-205874b75e7d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:41.742063 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fe10d2aa-8b36-4668-ad14-205874b75e7d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1809 microversion: 2.20 time: 0.169681 Aug 24 03:55:41.743484 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 245/485] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:41 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:41.828250 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-cc22b0e8-7411-43a1-b6b2-083e682f5035 req-c780cd52-212b-4c33-8a1f-fdc909924473 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8b22210-7e08-4f01-bf00-d84b0e5e34d7", "name": "network-vif-plugged", "status": "completed", "tag": "a6ef21fe-e9ce-414a-a115-1f2f2babf6fc"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:41.834843 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_api:SELECT=48 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:41.840382 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-cc22b0e8-7411-43a1-b6b2-083e682f5035 req-c780cd52-212b-4c33-8a1f-fdc909924473 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:41.841171 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-cc22b0e8-7411-43a1-b6b2-083e682f5035 req-c780cd52-212b-4c33-8a1f-fdc909924473 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:41.841608 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-cc22b0e8-7411-43a1-b6b2-083e682f5035 req-c780cd52-212b-4c33-8a1f-fdc909924473 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:41.856556 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-cc22b0e8-7411-43a1-b6b2-083e682f5035 req-c780cd52-212b-4c33-8a1f-fdc909924473 service nova] Creating event network-vif-plugged:a6ef21fe-e9ce-414a-a115-1f2f2babf6fc for instance b8b22210-7e08-4f01-bf00-d84b0e5e34d7 on hv-cinder-85426 Aug 24 03:55:41.861940 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-cc22b0e8-7411-43a1-b6b2-083e682f5035 req-c780cd52-212b-4c33-8a1f-fdc909924473 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038783 Aug 24 03:55:41.862633 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 241/486] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:42.767197 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-665ed8df-d047-4bea-8d02-5d14e944d99a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:42.767795 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-665ed8df-d047-4bea-8d02-5d14e944d99a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:42.774205 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-665ed8df-d047-4bea-8d02-5d14e944d99a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:42.774823 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-665ed8df-d047-4bea-8d02-5d14e944d99a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:42.775254 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-665ed8df-d047-4bea-8d02-5d14e944d99a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:42.775931 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-665ed8df-d047-4bea-8d02-5d14e944d99a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:42.776375 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-665ed8df-d047-4bea-8d02-5d14e944d99a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:42.776888 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-665ed8df-d047-4bea-8d02-5d14e944d99a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:42.914589 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-665ed8df-d047-4bea-8d02-5d14e944d99a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:42.924104 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-665ed8df-d047-4bea-8d02-5d14e944d99a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:42.925598 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-665ed8df-d047-4bea-8d02-5d14e944d99a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:42.926974 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-665ed8df-d047-4bea-8d02-5d14e944d99a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1809 microversion: 2.20 time: 0.163591 Aug 24 03:55:42.927527 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 246/487] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:42 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:43.951649 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-8e079953-eda5-47e1-9f51-42aaa613d3ff tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:43.952348 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-8e079953-eda5-47e1-9f51-42aaa613d3ff tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:43.958791 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8e079953-eda5-47e1-9f51-42aaa613d3ff tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:43.962014 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8e079953-eda5-47e1-9f51-42aaa613d3ff tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:43.962014 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8e079953-eda5-47e1-9f51-42aaa613d3ff tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:43.962014 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8e079953-eda5-47e1-9f51-42aaa613d3ff tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:43.962014 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8e079953-eda5-47e1-9f51-42aaa613d3ff tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:43.962355 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8e079953-eda5-47e1-9f51-42aaa613d3ff tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:44.099625 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-8e079953-eda5-47e1-9f51-42aaa613d3ff tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:44.108271 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-8e079953-eda5-47e1-9f51-42aaa613d3ff tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:44.109765 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-8e079953-eda5-47e1-9f51-42aaa613d3ff tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:44.110952 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-8e079953-eda5-47e1-9f51-42aaa613d3ff tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1809 microversion: 2.20 time: 0.164807 Aug 24 03:55:44.111510 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 242/488] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:43 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:45.133424 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d43b895a-0eeb-4c21-b6d1-174360e5e41e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:45.134138 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d43b895a-0eeb-4c21-b6d1-174360e5e41e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:45.141162 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d43b895a-0eeb-4c21-b6d1-174360e5e41e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:45.141702 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d43b895a-0eeb-4c21-b6d1-174360e5e41e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:45.142143 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d43b895a-0eeb-4c21-b6d1-174360e5e41e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:45.142858 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d43b895a-0eeb-4c21-b6d1-174360e5e41e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:45.143308 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d43b895a-0eeb-4c21-b6d1-174360e5e41e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:45.143723 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d43b895a-0eeb-4c21-b6d1-174360e5e41e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:45.286606 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-d43b895a-0eeb-4c21-b6d1-174360e5e41e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:45.295293 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-d43b895a-0eeb-4c21-b6d1-174360e5e41e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:45.296797 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-d43b895a-0eeb-4c21-b6d1-174360e5e41e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:45.297982 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d43b895a-0eeb-4c21-b6d1-174360e5e41e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1809 microversion: 2.20 time: 0.168591 Aug 24 03:55:45.298563 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 247/489] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:45 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:55:46.321181 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-3a953d9d-3664-4ac0-8615-df02467bf9d1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:46.321781 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-3a953d9d-3664-4ac0-8615-df02467bf9d1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:46.328916 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3a953d9d-3664-4ac0-8615-df02467bf9d1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:46.329391 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3a953d9d-3664-4ac0-8615-df02467bf9d1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:46.329815 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3a953d9d-3664-4ac0-8615-df02467bf9d1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:46.330497 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3a953d9d-3664-4ac0-8615-df02467bf9d1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:46.331015 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3a953d9d-3664-4ac0-8615-df02467bf9d1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:46.331430 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3a953d9d-3664-4ac0-8615-df02467bf9d1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:46.351338 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell1:SELECT=100 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:46.465110 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-3a953d9d-3664-4ac0-8615-df02467bf9d1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:46.473599 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-3a953d9d-3664-4ac0-8615-df02467bf9d1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:46.475130 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-3a953d9d-3664-4ac0-8615-df02467bf9d1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:46.476310 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-3a953d9d-3664-4ac0-8615-df02467bf9d1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1796 microversion: 2.20 time: 0.159025 Aug 24 03:55:46.476858 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 243/490] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:46 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1796 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:08.328739 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1dbf0227-9940-4419-9132-513ad13b21c5 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:56:08.330970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1dbf0227-9940-4419-9132-513ad13b21c5 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:08.333117 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=7 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:08.333798 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=48 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:08.339108 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1dbf0227-9940-4419-9132-513ad13b21c5 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:08.339594 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1dbf0227-9940-4419-9132-513ad13b21c5 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:08.340033 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1dbf0227-9940-4419-9132-513ad13b21c5 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:08.340725 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1dbf0227-9940-4419-9132-513ad13b21c5 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:08.341181 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1dbf0227-9940-4419-9132-513ad13b21c5 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:08.341606 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1dbf0227-9940-4419-9132-513ad13b21c5 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:08.594349 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1dbf0227-9940-4419-9132-513ad13b21c5 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "POST /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7/action" status: 202 len: 0 microversion: 2.1 time: 0.269378 Aug 24 03:56:08.594938 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 248/491] 10.222.0.82 () {60 vars in 1278 bytes} [Wed Aug 24 03:56:08 2022] POST /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:56:08.603700 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-c38a2996-5c18-4137-ad1e-3b962f8f6351 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:08.605827 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-c38a2996-5c18-4137-ad1e-3b962f8f6351 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:08.606831 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_api:SELECT=5 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:08.611956 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c38a2996-5c18-4137-ad1e-3b962f8f6351 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:08.612435 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c38a2996-5c18-4137-ad1e-3b962f8f6351 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:08.612906 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c38a2996-5c18-4137-ad1e-3b962f8f6351 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:08.613592 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c38a2996-5c18-4137-ad1e-3b962f8f6351 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:08.614030 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c38a2996-5c18-4137-ad1e-3b962f8f6351 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:08.614448 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c38a2996-5c18-4137-ad1e-3b962f8f6351 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:08.763843 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-c38a2996-5c18-4137-ad1e-3b962f8f6351 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:08.778161 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-c38a2996-5c18-4137-ad1e-3b962f8f6351 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1749 microversion: 2.1 time: 0.178555 Aug 24 03:56:08.779081 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 244/492] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:08 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1749 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:09.610673 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6aa593b1-c193-4d54-8fa2-08acb39eff17 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:09.611239 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6aa593b1-c193-4d54-8fa2-08acb39eff17 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:09.617381 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6aa593b1-c193-4d54-8fa2-08acb39eff17 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:09.617858 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6aa593b1-c193-4d54-8fa2-08acb39eff17 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:09.618288 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6aa593b1-c193-4d54-8fa2-08acb39eff17 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:09.619814 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6aa593b1-c193-4d54-8fa2-08acb39eff17 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:09.619814 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6aa593b1-c193-4d54-8fa2-08acb39eff17 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:09.620683 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6aa593b1-c193-4d54-8fa2-08acb39eff17 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:09.758119 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-6aa593b1-c193-4d54-8fa2-08acb39eff17 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lazy-loading 'services' on Instance uuid 0aa2d996-08d6-46ce-b978-5de69b34a0f6 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:56:09.801146 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-be1811e4-4063-47d8-9dd2-f0be40dc4d99 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:09.801820 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-be1811e4-4063-47d8-9dd2-f0be40dc4d99 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:09.810073 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-be1811e4-4063-47d8-9dd2-f0be40dc4d99 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:09.810591 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-be1811e4-4063-47d8-9dd2-f0be40dc4d99 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:09.811028 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-be1811e4-4063-47d8-9dd2-f0be40dc4d99 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:09.811732 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-be1811e4-4063-47d8-9dd2-f0be40dc4d99 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:09.812182 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-be1811e4-4063-47d8-9dd2-f0be40dc4d99 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:09.812601 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-be1811e4-4063-47d8-9dd2-f0be40dc4d99 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:09.971697 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-be1811e4-4063-47d8-9dd2-f0be40dc4d99 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:09.982251 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-be1811e4-4063-47d8-9dd2-f0be40dc4d99 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1754 microversion: 2.1 time: 0.185519 Aug 24 03:56:09.982844 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 245/493] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:09 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1754 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:56:10.045786 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6aa593b1-c193-4d54-8fa2-08acb39eff17 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "DELETE /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6/os-volume_attachments/5aeabfee-2ba2-480b-ac82-d66ed0ea05a0" status: 202 len: 0 microversion: 2.1 time: 0.439689 Aug 24 03:56:10.046396 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 249/494] 10.222.0.82 () {58 vars in 1416 bytes} [Wed Aug 24 03:56:09 2022] DELETE /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6/os-volume_attachments/5aeabfee-2ba2-480b-ac82-d66ed0ea05a0 => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:56:11.004450 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-ceb0df82-8438-4fbb-b07d-51b72fa5f916 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:11.005059 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-ceb0df82-8438-4fbb-b07d-51b72fa5f916 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:11.011907 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ceb0df82-8438-4fbb-b07d-51b72fa5f916 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:11.012382 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ceb0df82-8438-4fbb-b07d-51b72fa5f916 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:11.012806 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ceb0df82-8438-4fbb-b07d-51b72fa5f916 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:11.013496 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ceb0df82-8438-4fbb-b07d-51b72fa5f916 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:11.013967 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ceb0df82-8438-4fbb-b07d-51b72fa5f916 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:11.014385 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ceb0df82-8438-4fbb-b07d-51b72fa5f916 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:11.171433 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-ceb0df82-8438-4fbb-b07d-51b72fa5f916 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:11.179813 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-ceb0df82-8438-4fbb-b07d-51b72fa5f916 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1754 microversion: 2.1 time: 0.179099 Aug 24 03:56:11.180449 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 246/495] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:10 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1754 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:11.268315 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-96b1aab3-bc87-457c-8cb8-fe201b7e489b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:11.268872 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-96b1aab3-bc87-457c-8cb8-fe201b7e489b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: b7890971-d4d3-4a0e-bc58-b428eb8c5f0e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:11.275980 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96b1aab3-bc87-457c-8cb8-fe201b7e489b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:11.276465 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96b1aab3-bc87-457c-8cb8-fe201b7e489b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:11.276890 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96b1aab3-bc87-457c-8cb8-fe201b7e489b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:11.277580 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96b1aab3-bc87-457c-8cb8-fe201b7e489b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:11.278135 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96b1aab3-bc87-457c-8cb8-fe201b7e489b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:11.278574 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-96b1aab3-bc87-457c-8cb8-fe201b7e489b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:11.301471 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-96b1aab3-bc87-457c-8cb8-fe201b7e489b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e/ips" status: 200 len: 151 microversion: 2.1 time: 0.038083 Aug 24 03:56:11.302026 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 250/496] 10.222.0.82 () {58 vars in 1248 bytes} [Wed Aug 24 03:56:11 2022] GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:56:11.313638 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-47ec89b7-b99e-4269-bcbe-ecbf65db7dee tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06095bd4-0045-4e25-9218-6054073d94e4"}} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:56:11.316095 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-47ec89b7-b99e-4269-bcbe-ecbf65db7dee tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: b7890971-d4d3-4a0e-bc58-b428eb8c5f0e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:11.322539 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-47ec89b7-b99e-4269-bcbe-ecbf65db7dee tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:11.323121 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-47ec89b7-b99e-4269-bcbe-ecbf65db7dee tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:11.323551 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-47ec89b7-b99e-4269-bcbe-ecbf65db7dee tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:11.324240 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-47ec89b7-b99e-4269-bcbe-ecbf65db7dee tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:11.324684 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-47ec89b7-b99e-4269-bcbe-ecbf65db7dee tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:11.325103 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-47ec89b7-b99e-4269-bcbe-ecbf65db7dee tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:11.410227 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.wsgi [None req-47ec89b7-b99e-4269-bcbe-ecbf65db7dee tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] HTTP exception thrown: Invalid volume: volume 06095bd4-0045-4e25-9218-6054073d94e4 is already attached to instances: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b Aug 24 03:56:11.412212 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-47ec89b7-b99e-4269-bcbe-ecbf65db7dee tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Request method failure captured: Aug 24 03:56:11.412212 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: request: POST /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e/os-volume_attachments HTTP/1.1 Aug 24 03:56:11.412212 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept: application/json Aug 24 03:56:11.412212 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept-Encoding: identity Aug 24 03:56:11.412212 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Connection: close Aug 24 03:56:11.412212 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Length: 74 Aug 24 03:56:11.412212 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Type: application/json Aug 24 03:56:11.412212 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Host: 10.222.0.82 Aug 24 03:56:11.412212 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Openstack-System-Scope: None Aug 24 03:56:11.412212 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: User-Agent: python-urllib3/1.26.11 Aug 24 03:56:11.412212 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Auth-Token: gAAAAABjBaByYUQ7dP595ip40_OJ_0ufC71Rc-FPYS4vZXmmx4Fislhg9iz6FfvLLHiwJ4Ed0bFNDX6fhqS1zmk_A3EKqVLHT9Pz2gZaaIcE0OalzJoOw2sqfwO-7iDYasbxHIEhvzvTJNavoRaspbu_b6_R5EZ70Pa8SKRgBtFA8vqfpAdszSk Aug 24 03:56:11.412212 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Id: None Aug 24 03:56:11.412212 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Name: None Aug 24 03:56:11.412212 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Identity-Status: Confirmed Aug 24 03:56:11.412212 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Is-Admin-Project: True Aug 24 03:56:11.412212 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Id: default Aug 24 03:56:11.412212 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Name: Default Aug 24 03:56:11.412212 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Id: 46ef5b02d8da4d2eac26b6ccfb35e1a4 Aug 24 03:56:11.412212 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Name: tempest-AttachVolumeNegativeTest-477133645 Aug 24 03:56:11.412212 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Role: member,reader Aug 24 03:56:11.412212 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Roles: member,reader Aug 24 03:56:11.413853 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/46ef5b02d8da4d2eac26b6ccfb35e1a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/46ef5b02d8da4d2eac26b6ccfb35e1a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/46ef5b02d8da4d2eac26b6ccfb35e1a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_46ef5b02d8da4d2eac26b6ccfb35e1a4", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:56:11.413853 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant: tempest-AttachVolumeNegativeTest-477133645 Aug 24 03:56:11.413853 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Id: 46ef5b02d8da4d2eac26b6ccfb35e1a4 Aug 24 03:56:11.413853 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-477133645 Aug 24 03:56:11.413853 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User: tempest-AttachVolumeNegativeTest-477133645-project Aug 24 03:56:11.413853 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Id: default Aug 24 03:56:11.413853 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Name: Default Aug 24 03:56:11.413853 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Id: e5582d10ebef459084fe287c18568f98 Aug 24 03:56:11.413853 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Name: tempest-AttachVolumeNegativeTest-477133645-project Aug 24 03:56:11.413853 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Aug 24 03:56:11.413853 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: {"volumeAttachment": {"volumeId": "06095bd4-0045-4e25-9218-6054073d94e4"}} Aug 24 03:56:11.413853 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: method: > Aug 24 03:56:11.414757 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: exception: Invalid volume: volume 06095bd4-0045-4e25-9218-6054073d94e4 is already attached to instances: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b Aug 24 03:56:11.414757 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: action_args: {'server_id': 'b7890971-d4d3-4a0e-bc58-b428eb8c5f0e', 'body': {'volumeAttachment': {'volumeId': '06095bd4-0045-4e25-9218-6054073d94e4'}}} Aug 24 03:56:11.414757 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:56:11.414757 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:56:11.414757 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 03:56:11.414757 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 03:56:11.414757 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 03:56:11.414757 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 03:56:11.414757 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 03:56:11.414757 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 03:56:11.414757 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 03:56:11.414757 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 03:56:11.414757 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 03:56:11.414757 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 03:56:11.414757 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 06095bd4-0045-4e25-9218-6054073d94e4 is already attached to instances: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b Aug 24 03:56:11.414757 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:56:11.414757 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:56:11.414757 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:56:11.414757 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:56:11.415994 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:56:11.415994 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:56:11.415994 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:56:11.415994 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:56:11.415994 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:56:11.415994 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:56:11.415994 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:56:11.415994 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:56:11.415994 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:56:11.415994 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:56:11.415994 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:56:11.415994 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:56:11.415994 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 03:56:11.415994 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 03:56:11.415994 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 06095bd4-0045-4e25-9218-6054073d94e4 is already attached to instances: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b Aug 24 03:56:11.415994 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:56:11.415994 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:56:11.415994 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:56:11.415994 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:56:11.415994 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:56:11.417197 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:56:11.417197 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:56:11.417197 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:56:11.417197 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 06095bd4-0045-4e25-9218-6054073d94e4 is already attached to instances: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b Aug 24 03:56:11.417197 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:56:11.417197 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-47ec89b7-b99e-4269-bcbe-ecbf65db7dee tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Returning 400 to user: Invalid volume: volume 06095bd4-0045-4e25-9218-6054073d94e4 is already attached to instances: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b {{(pid=127869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:56:11.417197 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-47ec89b7-b99e-4269-bcbe-ecbf65db7dee tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "POST /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104073 Aug 24 03:56:11.417197 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 247/497] 10.222.0.82 () {60 vars in 1323 bytes} [Wed Aug 24 03:56:11 2022] POST /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:56:11.422664 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-79b9e47e-8572-45cc-97be-c97191c82b89 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:11.423157 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-79b9e47e-8572-45cc-97be-c97191c82b89 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: b7890971-d4d3-4a0e-bc58-b428eb8c5f0e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:11.429025 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79b9e47e-8572-45cc-97be-c97191c82b89 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:11.429491 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79b9e47e-8572-45cc-97be-c97191c82b89 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:11.429916 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79b9e47e-8572-45cc-97be-c97191c82b89 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:11.430620 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79b9e47e-8572-45cc-97be-c97191c82b89 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:11.431604 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79b9e47e-8572-45cc-97be-c97191c82b89 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:11.432029 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79b9e47e-8572-45cc-97be-c97191c82b89 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:11.457416 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-79b9e47e-8572-45cc-97be-c97191c82b89 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: b7890971-d4d3-4a0e-bc58-b428eb8c5f0e] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:56:11.760477 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-79b9e47e-8572-45cc-97be-c97191c82b89 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "DELETE /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e" status: 204 len: 0 microversion: 2.1 time: 0.341098 Aug 24 03:56:11.761064 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 251/498] 10.222.0.82 () {58 vars in 1239 bytes} [Wed Aug 24 03:56:11 2022] DELETE /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:56:11.769433 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-999e4b40-9267-4a69-86d7-6bd07d77a1ec tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:11.770046 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-999e4b40-9267-4a69-86d7-6bd07d77a1ec tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: b7890971-d4d3-4a0e-bc58-b428eb8c5f0e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:11.776690 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-999e4b40-9267-4a69-86d7-6bd07d77a1ec tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:11.777176 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-999e4b40-9267-4a69-86d7-6bd07d77a1ec tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:11.777608 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-999e4b40-9267-4a69-86d7-6bd07d77a1ec tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:11.778301 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-999e4b40-9267-4a69-86d7-6bd07d77a1ec tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:11.778779 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-999e4b40-9267-4a69-86d7-6bd07d77a1ec tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:11.779204 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-999e4b40-9267-4a69-86d7-6bd07d77a1ec tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:11.918474 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-999e4b40-9267-4a69-86d7-6bd07d77a1ec tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:11.926847 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-999e4b40-9267-4a69-86d7-6bd07d77a1ec tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e" status: 200 len: 1683 microversion: 2.1 time: 0.160918 Aug 24 03:56:11.927423 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 248/499] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:11 2022] GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:12.202880 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a8d7289c-d07b-4973-8887-df10518ea08f tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:12.203581 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a8d7289c-d07b-4973-8887-df10518ea08f tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:12.209468 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8d7289c-d07b-4973-8887-df10518ea08f tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:12.209955 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8d7289c-d07b-4973-8887-df10518ea08f tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:12.210462 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8d7289c-d07b-4973-8887-df10518ea08f tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:12.211296 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8d7289c-d07b-4973-8887-df10518ea08f tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:12.211637 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8d7289c-d07b-4973-8887-df10518ea08f tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:12.212733 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8d7289c-d07b-4973-8887-df10518ea08f tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:12.358924 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-a8d7289c-d07b-4973-8887-df10518ea08f tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:12.367594 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a8d7289c-d07b-4973-8887-df10518ea08f tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1754 microversion: 2.1 time: 0.169267 Aug 24 03:56:12.368197 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 252/500] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:12 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:12.950490 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-14672137-1a62-4a23-934a-4f2c18a30259 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:12.951065 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-14672137-1a62-4a23-934a-4f2c18a30259 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: b7890971-d4d3-4a0e-bc58-b428eb8c5f0e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:12.957635 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-14672137-1a62-4a23-934a-4f2c18a30259 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:12.958113 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-14672137-1a62-4a23-934a-4f2c18a30259 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:12.958572 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-14672137-1a62-4a23-934a-4f2c18a30259 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:12.959256 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-14672137-1a62-4a23-934a-4f2c18a30259 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:12.959707 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-14672137-1a62-4a23-934a-4f2c18a30259 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:12.960129 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-14672137-1a62-4a23-934a-4f2c18a30259 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:13.090271 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-14672137-1a62-4a23-934a-4f2c18a30259 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:13.097913 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-14672137-1a62-4a23-934a-4f2c18a30259 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e" status: 200 len: 1683 microversion: 2.1 time: 0.152205 Aug 24 03:56:13.098477 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 249/501] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:12 2022] GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:13.389322 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ba388c5a-a8ae-4132-a4e5-c91add2316fd tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:13.389926 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ba388c5a-a8ae-4132-a4e5-c91add2316fd tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:13.396377 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba388c5a-a8ae-4132-a4e5-c91add2316fd tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:13.396848 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba388c5a-a8ae-4132-a4e5-c91add2316fd tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:13.397274 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba388c5a-a8ae-4132-a4e5-c91add2316fd tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:13.397948 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba388c5a-a8ae-4132-a4e5-c91add2316fd tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:13.398393 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba388c5a-a8ae-4132-a4e5-c91add2316fd tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:13.398902 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba388c5a-a8ae-4132-a4e5-c91add2316fd tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:13.551437 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-ba388c5a-a8ae-4132-a4e5-c91add2316fd tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:13.560571 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ba388c5a-a8ae-4132-a4e5-c91add2316fd tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1754 microversion: 2.1 time: 0.175302 Aug 24 03:56:13.561141 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 253/502] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:13 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:14.119494 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-9d5a1321-6531-4faf-87f3-7724ded13c2e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:14.120115 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-9d5a1321-6531-4faf-87f3-7724ded13c2e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: b7890971-d4d3-4a0e-bc58-b428eb8c5f0e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:14.126449 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9d5a1321-6531-4faf-87f3-7724ded13c2e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:14.126958 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9d5a1321-6531-4faf-87f3-7724ded13c2e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:14.127388 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9d5a1321-6531-4faf-87f3-7724ded13c2e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:14.128078 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9d5a1321-6531-4faf-87f3-7724ded13c2e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:14.128555 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9d5a1321-6531-4faf-87f3-7724ded13c2e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:14.128941 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9d5a1321-6531-4faf-87f3-7724ded13c2e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:14.257619 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-9d5a1321-6531-4faf-87f3-7724ded13c2e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:14.266473 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-9d5a1321-6531-4faf-87f3-7724ded13c2e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e" status: 200 len: 1683 microversion: 2.1 time: 0.150858 Aug 24 03:56:14.267073 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 250/503] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:14 2022] GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:14.581093 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e5379ed0-0c37-4302-97c9-580221833e35 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:14.582439 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e5379ed0-0c37-4302-97c9-580221833e35 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:14.589276 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e5379ed0-0c37-4302-97c9-580221833e35 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:14.591252 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e5379ed0-0c37-4302-97c9-580221833e35 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:14.591252 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e5379ed0-0c37-4302-97c9-580221833e35 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:14.591252 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e5379ed0-0c37-4302-97c9-580221833e35 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:14.591541 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e5379ed0-0c37-4302-97c9-580221833e35 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:14.591767 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e5379ed0-0c37-4302-97c9-580221833e35 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:14.628423 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-1908d6b9-01a5-4833-816e-83102e018886 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0169d1b4-a937-48d3-94ab-dd92b5a558a3"}} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:56:14.630806 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-1908d6b9-01a5-4833-816e-83102e018886 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:14.638198 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1908d6b9-01a5-4833-816e-83102e018886 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:14.638712 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1908d6b9-01a5-4833-816e-83102e018886 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:14.639151 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1908d6b9-01a5-4833-816e-83102e018886 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:14.639849 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1908d6b9-01a5-4833-816e-83102e018886 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:14.640307 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1908d6b9-01a5-4833-816e-83102e018886 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:14.640730 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1908d6b9-01a5-4833-816e-83102e018886 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:14.848622 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-e5379ed0-0c37-4302-97c9-580221833e35 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:14.857115 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e5379ed0-0c37-4302-97c9-580221833e35 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1754 microversion: 2.1 time: 0.279818 Aug 24 03:56:14.857716 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 254/504] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:14 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1754 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:15.246199 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-10d6f4ef-2136-46b3-b3a4-1649173a6a09 req-24b8374a-6746-430d-b3aa-7d875910e993 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7890971-d4d3-4a0e-bc58-b428eb8c5f0e", "name": "network-vif-deleted", "tag": "898dcdfe-5a41-42a9-ab1f-09c5ef9e676b"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:56:15.256583 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-10d6f4ef-2136-46b3-b3a4-1649173a6a09 req-24b8374a-6746-430d-b3aa-7d875910e993 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:15.257055 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-10d6f4ef-2136-46b3-b3a4-1649173a6a09 req-24b8374a-6746-430d-b3aa-7d875910e993 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:15.257481 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-10d6f4ef-2136-46b3-b3a4-1649173a6a09 req-24b8374a-6746-430d-b3aa-7d875910e993 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:15.268795 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-10d6f4ef-2136-46b3-b3a4-1649173a6a09 req-24b8374a-6746-430d-b3aa-7d875910e993 service nova] Creating event network-vif-deleted:898dcdfe-5a41-42a9-ab1f-09c5ef9e676b for instance b7890971-d4d3-4a0e-bc58-b428eb8c5f0e on hv-cinder-85426 Aug 24 03:56:15.273801 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-10d6f4ef-2136-46b3-b3a4-1649173a6a09 req-24b8374a-6746-430d-b3aa-7d875910e993 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031811 Aug 24 03:56:15.275257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 255/505] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:56:15.287975 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b650ef3c-2c30-4a21-9591-27f9312c79bf tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:15.293004 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b650ef3c-2c30-4a21-9591-27f9312c79bf tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: b7890971-d4d3-4a0e-bc58-b428eb8c5f0e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:15.295082 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b650ef3c-2c30-4a21-9591-27f9312c79bf tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:15.295565 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b650ef3c-2c30-4a21-9591-27f9312c79bf tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:15.295998 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b650ef3c-2c30-4a21-9591-27f9312c79bf tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:15.296686 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b650ef3c-2c30-4a21-9591-27f9312c79bf tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:15.297137 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b650ef3c-2c30-4a21-9591-27f9312c79bf tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:15.297559 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b650ef3c-2c30-4a21-9591-27f9312c79bf tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:15.365297 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-b650ef3c-2c30-4a21-9591-27f9312c79bf tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:15.378852 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b650ef3c-2c30-4a21-9591-27f9312c79bf tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e" status: 200 len: 1616 microversion: 2.1 time: 0.093401 Aug 24 03:56:15.380042 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 256/506] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:15 2022] GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e => generated 1616 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:15.414594 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7779a51a-6f26-4260-97b0-e3aa5c6d58b3 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:56:15.420624 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7779a51a-6f26-4260-97b0-e3aa5c6d58b3 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:15.421117 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7779a51a-6f26-4260-97b0-e3aa5c6d58b3 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:15.421594 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7779a51a-6f26-4260-97b0-e3aa5c6d58b3 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:15.447478 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7779a51a-6f26-4260-97b0-e3aa5c6d58b3 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Going to try to stop instance {{(pid=127870) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 03:56:15.658118 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-1908d6b9-01a5-4833-816e-83102e018886 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "POST /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.033810 Aug 24 03:56:15.660271 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 251/507] 10.222.0.82 () {60 vars in 1323 bytes} [Wed Aug 24 03:56:14 2022] POST /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70/os-volume_attachments => generated 194 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:56:15.735084 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7779a51a-6f26-4260-97b0-e3aa5c6d58b3 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "POST /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6/action" status: 202 len: 0 microversion: 2.1 time: 0.324166 Aug 24 03:56:15.735713 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 257/508] 10.222.0.82 () {60 vars in 1278 bytes} [Wed Aug 24 03:56:15 2022] POST /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:56:15.745948 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-96f94ae6-da96-42f6-b82e-d96c5f2bc089 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:15.748906 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-96f94ae6-da96-42f6-b82e-d96c5f2bc089 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:15.764185 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-96f94ae6-da96-42f6-b82e-d96c5f2bc089 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:15.764662 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-96f94ae6-da96-42f6-b82e-d96c5f2bc089 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:15.765286 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-96f94ae6-da96-42f6-b82e-d96c5f2bc089 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:15.766045 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-96f94ae6-da96-42f6-b82e-d96c5f2bc089 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:15.766537 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-96f94ae6-da96-42f6-b82e-d96c5f2bc089 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:15.766953 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-96f94ae6-da96-42f6-b82e-d96c5f2bc089 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:15.879486 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bea5a4a7-4a26-43dd-b1b3-8102e7487fb0 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:15.882035 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bea5a4a7-4a26-43dd-b1b3-8102e7487fb0 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:15.894365 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bea5a4a7-4a26-43dd-b1b3-8102e7487fb0 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:15.894951 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bea5a4a7-4a26-43dd-b1b3-8102e7487fb0 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:15.895389 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bea5a4a7-4a26-43dd-b1b3-8102e7487fb0 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:15.896095 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bea5a4a7-4a26-43dd-b1b3-8102e7487fb0 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:15.896555 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bea5a4a7-4a26-43dd-b1b3-8102e7487fb0 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:15.896976 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bea5a4a7-4a26-43dd-b1b3-8102e7487fb0 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:15.936698 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-96f94ae6-da96-42f6-b82e-d96c5f2bc089 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:15.945505 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-96f94ae6-da96-42f6-b82e-d96c5f2bc089 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1676 microversion: 2.1 time: 0.204945 Aug 24 03:56:15.946892 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 252/509] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:15 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1676 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:16.058310 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-bea5a4a7-4a26-43dd-b1b3-8102e7487fb0 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:16.066844 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bea5a4a7-4a26-43dd-b1b3-8102e7487fb0 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1754 microversion: 2.1 time: 0.191546 Aug 24 03:56:16.067672 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 258/510] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:15 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1754 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:16.402950 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-d1ae9cde-6045-4f5e-b4fa-d67990149145 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:16.403849 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-d1ae9cde-6045-4f5e-b4fa-d67990149145 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: b7890971-d4d3-4a0e-bc58-b428eb8c5f0e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:16.410361 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d1ae9cde-6045-4f5e-b4fa-d67990149145 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:16.416209 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d1ae9cde-6045-4f5e-b4fa-d67990149145 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:16.416209 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d1ae9cde-6045-4f5e-b4fa-d67990149145 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:16.416209 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d1ae9cde-6045-4f5e-b4fa-d67990149145 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:16.416209 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d1ae9cde-6045-4f5e-b4fa-d67990149145 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:16.416607 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d1ae9cde-6045-4f5e-b4fa-d67990149145 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:16.448876 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d1ae9cde-6045-4f5e-b4fa-d67990149145 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:16.449610 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d1ae9cde-6045-4f5e-b4fa-d67990149145 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:16.450038 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d1ae9cde-6045-4f5e-b4fa-d67990149145 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:16.450486 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.objects.instance [None req-d1ae9cde-6045-4f5e-b4fa-d67990149145 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lazy-loading 'fault' on Instance uuid b7890971-d4d3-4a0e-bc58-b428eb8c5f0e {{(pid=127869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:56:16.500508 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-d1ae9cde-6045-4f5e-b4fa-d67990149145 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:16.511041 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-d1ae9cde-6045-4f5e-b4fa-d67990149145 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e" status: 200 len: 1332 microversion: 2.1 time: 0.112243 Aug 24 03:56:16.511772 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 253/511] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:16 2022] GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e => generated 1332 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:16.967887 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-54a915c1-4b9d-4788-b3c1-84f7ea47b537 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:16.968507 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-54a915c1-4b9d-4788-b3c1-84f7ea47b537 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:16.975324 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54a915c1-4b9d-4788-b3c1-84f7ea47b537 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:16.975813 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54a915c1-4b9d-4788-b3c1-84f7ea47b537 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:16.976260 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54a915c1-4b9d-4788-b3c1-84f7ea47b537 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:16.977762 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54a915c1-4b9d-4788-b3c1-84f7ea47b537 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:16.978238 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54a915c1-4b9d-4788-b3c1-84f7ea47b537 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:16.978698 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54a915c1-4b9d-4788-b3c1-84f7ea47b537 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:17.089655 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-60badfe3-3fe2-402c-b2e3-1668b12f3807 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:17.090274 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-60badfe3-3fe2-402c-b2e3-1668b12f3807 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:17.096759 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-60badfe3-3fe2-402c-b2e3-1668b12f3807 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:17.097591 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-60badfe3-3fe2-402c-b2e3-1668b12f3807 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:17.098178 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-60badfe3-3fe2-402c-b2e3-1668b12f3807 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:17.101289 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-60badfe3-3fe2-402c-b2e3-1668b12f3807 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:17.101289 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-60badfe3-3fe2-402c-b2e3-1668b12f3807 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:17.101289 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-60badfe3-3fe2-402c-b2e3-1668b12f3807 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:17.136707 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-54a915c1-4b9d-4788-b3c1-84f7ea47b537 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:17.153163 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-54a915c1-4b9d-4788-b3c1-84f7ea47b537 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1676 microversion: 2.1 time: 0.184938 Aug 24 03:56:17.153163 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 259/512] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:16 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1676 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:17.272042 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-60badfe3-3fe2-402c-b2e3-1668b12f3807 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:17.283743 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-60badfe3-3fe2-402c-b2e3-1668b12f3807 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1754 microversion: 2.1 time: 0.198325 Aug 24 03:56:17.285401 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 254/513] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:17 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1754 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:56:17.532554 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-730f5d14-7da3-4242-b516-5de1c4ad67af tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:17.533187 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-730f5d14-7da3-4242-b516-5de1c4ad67af tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: b7890971-d4d3-4a0e-bc58-b428eb8c5f0e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:17.539180 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-730f5d14-7da3-4242-b516-5de1c4ad67af tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:17.539728 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-730f5d14-7da3-4242-b516-5de1c4ad67af tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:17.540212 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-730f5d14-7da3-4242-b516-5de1c4ad67af tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:17.541079 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-730f5d14-7da3-4242-b516-5de1c4ad67af tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:17.541533 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-730f5d14-7da3-4242-b516-5de1c4ad67af tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:17.541963 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-730f5d14-7da3-4242-b516-5de1c4ad67af tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:17.556538 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-730f5d14-7da3-4242-b516-5de1c4ad67af tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] HTTP exception thrown: Instance b7890971-d4d3-4a0e-bc58-b428eb8c5f0e could not be found. Aug 24 03:56:17.558246 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-730f5d14-7da3-4242-b516-5de1c4ad67af tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Request method failure captured: Aug 24 03:56:17.558246 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e HTTP/1.1 Aug 24 03:56:17.558246 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept: application/json Aug 24 03:56:17.558246 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept-Encoding: identity Aug 24 03:56:17.558246 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Connection: close Aug 24 03:56:17.558246 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Length: 0 Aug 24 03:56:17.558246 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Type: application/json Aug 24 03:56:17.558246 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Host: 10.222.0.82 Aug 24 03:56:17.558246 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Openstack-System-Scope: None Aug 24 03:56:17.558246 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.11 Aug 24 03:56:17.558246 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Auth-Token: gAAAAABjBaByYUQ7dP595ip40_OJ_0ufC71Rc-FPYS4vZXmmx4Fislhg9iz6FfvLLHiwJ4Ed0bFNDX6fhqS1zmk_A3EKqVLHT9Pz2gZaaIcE0OalzJoOw2sqfwO-7iDYasbxHIEhvzvTJNavoRaspbu_b6_R5EZ70Pa8SKRgBtFA8vqfpAdszSk Aug 24 03:56:17.558246 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Id: None Aug 24 03:56:17.558246 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Name: None Aug 24 03:56:17.558246 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Identity-Status: Confirmed Aug 24 03:56:17.558246 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Is-Admin-Project: True Aug 24 03:56:17.558246 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Id: default Aug 24 03:56:17.558246 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Name: Default Aug 24 03:56:17.558246 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Id: 46ef5b02d8da4d2eac26b6ccfb35e1a4 Aug 24 03:56:17.558246 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Name: tempest-AttachVolumeNegativeTest-477133645 Aug 24 03:56:17.558246 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Role: member,reader Aug 24 03:56:17.558246 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Roles: member,reader Aug 24 03:56:17.559771 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/46ef5b02d8da4d2eac26b6ccfb35e1a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/46ef5b02d8da4d2eac26b6ccfb35e1a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/46ef5b02d8da4d2eac26b6ccfb35e1a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_46ef5b02d8da4d2eac26b6ccfb35e1a4", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:56:17.559771 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant: tempest-AttachVolumeNegativeTest-477133645 Aug 24 03:56:17.559771 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Id: 46ef5b02d8da4d2eac26b6ccfb35e1a4 Aug 24 03:56:17.559771 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-477133645 Aug 24 03:56:17.559771 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User: tempest-AttachVolumeNegativeTest-477133645-project Aug 24 03:56:17.559771 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Id: default Aug 24 03:56:17.559771 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Name: Default Aug 24 03:56:17.559771 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Id: e5582d10ebef459084fe287c18568f98 Aug 24 03:56:17.559771 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Name: tempest-AttachVolumeNegativeTest-477133645-project Aug 24 03:56:17.559771 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: method: > Aug 24 03:56:17.559771 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: exception: Instance b7890971-d4d3-4a0e-bc58-b428eb8c5f0e could not be found. Aug 24 03:56:17.559771 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: action_args: {'id': 'b7890971-d4d3-4a0e-bc58-b428eb8c5f0e'} Aug 24 03:56:17.560582 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:56:17.560582 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:56:17.560582 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:56:17.560582 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:56:17.560582 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:56:17.560582 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:56:17.560582 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:56:17.560582 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:56:17.560582 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:56:17.560582 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:56:17.560582 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7890971-d4d3-4a0e-bc58-b428eb8c5f0e could not be found. Aug 24 03:56:17.560582 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:56:17.560582 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:56:17.560582 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:56:17.560582 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:56:17.560582 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:56:17.560582 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:56:17.560582 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:56:17.560582 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:56:17.560582 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:56:17.561824 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:56:17.561824 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:56:17.561824 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:56:17.561824 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:56:17.561824 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:56:17.561824 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:56:17.561824 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:56:17.561824 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7890971-d4d3-4a0e-bc58-b428eb8c5f0e could not be found. Aug 24 03:56:17.561824 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:56:17.561824 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:56:17.561824 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:56:17.561824 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:56:17.561824 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:56:17.561824 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:56:17.561824 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:56:17.561824 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:56:17.561824 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7890971-d4d3-4a0e-bc58-b428eb8c5f0e could not be found. Aug 24 03:56:17.561824 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:56:17.563121 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-730f5d14-7da3-4242-b516-5de1c4ad67af tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Returning 404 to user: Instance b7890971-d4d3-4a0e-bc58-b428eb8c5f0e could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:56:17.563121 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-730f5d14-7da3-4242-b516-5de1c4ad67af tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e" status: 404 len: 111 microversion: 2.1 time: 0.031085 Aug 24 03:56:17.563121 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 260/514] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:17 2022] GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:56:17.569181 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-51497b78-388d-494d-9b16-8f6e397d260b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '.version_select at 0x7f1554347ca0>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:17.716900 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-51497b78-388d-494d-9b16-8f6e397d260b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1852283799" status: 202 len: 0 microversion: 2.1 time: 0.151244 Aug 24 03:56:17.717679 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 255/515] 10.222.0.82 () {58 vars in 1221 bytes} [Wed Aug 24 03:56:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1852283799 => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:56:18.171229 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-25ba7206-faef-436d-ae99-ae0ea7761492 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:18.171960 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-25ba7206-faef-436d-ae99-ae0ea7761492 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:18.178805 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-25ba7206-faef-436d-ae99-ae0ea7761492 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:18.179368 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-25ba7206-faef-436d-ae99-ae0ea7761492 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:18.179804 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-25ba7206-faef-436d-ae99-ae0ea7761492 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:18.181194 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-25ba7206-faef-436d-ae99-ae0ea7761492 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:18.181796 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-25ba7206-faef-436d-ae99-ae0ea7761492 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:18.182228 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-25ba7206-faef-436d-ae99-ae0ea7761492 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:18.306253 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-466d23c4-8f34-4c97-977c-7c85a0cad1a9 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:18.307043 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-466d23c4-8f34-4c97-977c-7c85a0cad1a9 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:18.313931 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-466d23c4-8f34-4c97-977c-7c85a0cad1a9 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:18.314415 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-466d23c4-8f34-4c97-977c-7c85a0cad1a9 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:18.317958 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-466d23c4-8f34-4c97-977c-7c85a0cad1a9 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:18.317958 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-466d23c4-8f34-4c97-977c-7c85a0cad1a9 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:18.317958 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-466d23c4-8f34-4c97-977c-7c85a0cad1a9 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:18.317958 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-466d23c4-8f34-4c97-977c-7c85a0cad1a9 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:18.320807 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-25ba7206-faef-436d-ae99-ae0ea7761492 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:18.326583 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:18.331412 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-25ba7206-faef-436d-ae99-ae0ea7761492 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1676 microversion: 2.1 time: 0.164301 Aug 24 03:56:18.346214 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 261/516] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:18 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1676 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:18.488953 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-466d23c4-8f34-4c97-977c-7c85a0cad1a9 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:18.498278 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-466d23c4-8f34-4c97-977c-7c85a0cad1a9 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1754 microversion: 2.1 time: 0.196847 Aug 24 03:56:18.498886 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 256/517] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:18 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1754 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:56:18.648590 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cd3a64a4-ae97-45b1-9651-f506f1cdcff7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:18.649116 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cd3a64a4-ae97-45b1-9651-f506f1cdcff7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:18.655570 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cd3a64a4-ae97-45b1-9651-f506f1cdcff7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:18.656196 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cd3a64a4-ae97-45b1-9651-f506f1cdcff7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:18.656500 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cd3a64a4-ae97-45b1-9651-f506f1cdcff7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:18.657185 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cd3a64a4-ae97-45b1-9651-f506f1cdcff7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:18.657635 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cd3a64a4-ae97-45b1-9651-f506f1cdcff7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:18.658049 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cd3a64a4-ae97-45b1-9651-f506f1cdcff7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:18.738712 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-cd3a64a4-ae97-45b1-9651-f506f1cdcff7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lazy-loading 'services' on Instance uuid dd0bdd49-e4b5-4819-91f5-399d77f4dd4b {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:56:18.982842 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cd3a64a4-ae97-45b1-9651-f506f1cdcff7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "DELETE /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b/os-volume_attachments/06095bd4-0045-4e25-9218-6054073d94e4" status: 202 len: 0 microversion: 2.1 time: 0.338273 Aug 24 03:56:18.983628 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 262/518] 10.222.0.82 () {58 vars in 1416 bytes} [Wed Aug 24 03:56:18 2022] DELETE /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b/os-volume_attachments/06095bd4-0045-4e25-9218-6054073d94e4 => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:56:18.992276 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-b3e9495d-b86a-4d29-b557-bccdd0acf460 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:18.994534 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-b3e9495d-b86a-4d29-b557-bccdd0acf460 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:19.004297 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b3e9495d-b86a-4d29-b557-bccdd0acf460 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:19.004297 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b3e9495d-b86a-4d29-b557-bccdd0acf460 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:19.004297 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b3e9495d-b86a-4d29-b557-bccdd0acf460 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:19.004297 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b3e9495d-b86a-4d29-b557-bccdd0acf460 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:19.014592 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b3e9495d-b86a-4d29-b557-bccdd0acf460 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:19.014592 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b3e9495d-b86a-4d29-b557-bccdd0acf460 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:19.034384 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-b3e9495d-b86a-4d29-b557-bccdd0acf460 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046070 Aug 24 03:56:19.034978 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 257/519] 10.222.0.82 () {58 vars in 1302 bytes} [Wed Aug 24 03:56:18 2022] GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:56:19.354402 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e8a1fa0d-c1a7-4e7f-977c-3112fb24318d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:19.355122 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e8a1fa0d-c1a7-4e7f-977c-3112fb24318d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:19.361692 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8a1fa0d-c1a7-4e7f-977c-3112fb24318d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:19.362165 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8a1fa0d-c1a7-4e7f-977c-3112fb24318d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:19.363018 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8a1fa0d-c1a7-4e7f-977c-3112fb24318d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:19.363473 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8a1fa0d-c1a7-4e7f-977c-3112fb24318d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:19.363964 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8a1fa0d-c1a7-4e7f-977c-3112fb24318d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:19.364333 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8a1fa0d-c1a7-4e7f-977c-3112fb24318d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:19.500452 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-e8a1fa0d-c1a7-4e7f-977c-3112fb24318d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:19.508856 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e8a1fa0d-c1a7-4e7f-977c-3112fb24318d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1676 microversion: 2.1 time: 0.158794 Aug 24 03:56:19.510432 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 263/520] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:19 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:19.520929 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-623e7c72-41cd-424b-a108-a7bb9103a0ea tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:19.521554 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-623e7c72-41cd-424b-a108-a7bb9103a0ea tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:19.529070 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-623e7c72-41cd-424b-a108-a7bb9103a0ea tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:19.529570 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-623e7c72-41cd-424b-a108-a7bb9103a0ea tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:19.529994 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-623e7c72-41cd-424b-a108-a7bb9103a0ea tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:19.530694 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-623e7c72-41cd-424b-a108-a7bb9103a0ea tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:19.531138 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-623e7c72-41cd-424b-a108-a7bb9103a0ea tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:19.531549 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-623e7c72-41cd-424b-a108-a7bb9103a0ea tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:19.679292 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-623e7c72-41cd-424b-a108-a7bb9103a0ea tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:19.688183 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-623e7c72-41cd-424b-a108-a7bb9103a0ea tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1754 microversion: 2.1 time: 0.170977 Aug 24 03:56:19.688742 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 258/521] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:19 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:20.047217 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-921dac39-05fa-4426-88e9-f1202a873a00 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:20.049491 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-921dac39-05fa-4426-88e9-f1202a873a00 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:20.056413 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-921dac39-05fa-4426-88e9-f1202a873a00 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:20.056976 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-921dac39-05fa-4426-88e9-f1202a873a00 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:20.057421 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-921dac39-05fa-4426-88e9-f1202a873a00 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:20.058119 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-921dac39-05fa-4426-88e9-f1202a873a00 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:20.058614 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-921dac39-05fa-4426-88e9-f1202a873a00 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:20.059046 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-921dac39-05fa-4426-88e9-f1202a873a00 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:20.090351 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-921dac39-05fa-4426-88e9-f1202a873a00 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047036 Aug 24 03:56:20.090954 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 264/522] 10.222.0.82 () {58 vars in 1302 bytes} [Wed Aug 24 03:56:20 2022] GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:56:20.531921 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-22897d78-002a-45d6-a92b-af66c8117a6f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:20.532609 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-22897d78-002a-45d6-a92b-af66c8117a6f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:20.539393 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-22897d78-002a-45d6-a92b-af66c8117a6f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:20.540023 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-22897d78-002a-45d6-a92b-af66c8117a6f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:20.540931 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-22897d78-002a-45d6-a92b-af66c8117a6f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:20.541902 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-22897d78-002a-45d6-a92b-af66c8117a6f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:20.542352 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-22897d78-002a-45d6-a92b-af66c8117a6f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:20.542796 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-22897d78-002a-45d6-a92b-af66c8117a6f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:20.561871 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:20.675098 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-22897d78-002a-45d6-a92b-af66c8117a6f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:20.683514 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-22897d78-002a-45d6-a92b-af66c8117a6f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1676 microversion: 2.1 time: 0.155455 Aug 24 03:56:20.684090 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 259/523] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:20 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:20.709227 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c001b8ce-5eac-438d-8e6b-1234859dcde3 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:20.709922 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c001b8ce-5eac-438d-8e6b-1234859dcde3 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:20.717546 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c001b8ce-5eac-438d-8e6b-1234859dcde3 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:20.718031 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c001b8ce-5eac-438d-8e6b-1234859dcde3 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:20.718463 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c001b8ce-5eac-438d-8e6b-1234859dcde3 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:20.723481 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c001b8ce-5eac-438d-8e6b-1234859dcde3 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:20.723481 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c001b8ce-5eac-438d-8e6b-1234859dcde3 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:20.723481 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c001b8ce-5eac-438d-8e6b-1234859dcde3 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:20.863715 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-c001b8ce-5eac-438d-8e6b-1234859dcde3 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:20.872007 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c001b8ce-5eac-438d-8e6b-1234859dcde3 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1754 microversion: 2.1 time: 0.166809 Aug 24 03:56:20.872575 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 265/524] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:20 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:21.103871 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-8dcdf9f3-24d6-4595-8c34-9e3a22eab92c tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:21.106371 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-8dcdf9f3-24d6-4595-8c34-9e3a22eab92c tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:21.113169 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8dcdf9f3-24d6-4595-8c34-9e3a22eab92c tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:21.113647 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8dcdf9f3-24d6-4595-8c34-9e3a22eab92c tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:21.114082 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8dcdf9f3-24d6-4595-8c34-9e3a22eab92c tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:21.114804 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8dcdf9f3-24d6-4595-8c34-9e3a22eab92c tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:21.115256 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8dcdf9f3-24d6-4595-8c34-9e3a22eab92c tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:21.115678 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8dcdf9f3-24d6-4595-8c34-9e3a22eab92c tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:21.146077 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-8dcdf9f3-24d6-4595-8c34-9e3a22eab92c tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047348 Aug 24 03:56:21.146711 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 260/525] 10.222.0.82 () {58 vars in 1302 bytes} [Wed Aug 24 03:56:21 2022] GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:56:21.704355 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5823a8d3-90ff-4a1f-87a2-7016f425db70 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:21.704979 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5823a8d3-90ff-4a1f-87a2-7016f425db70 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:21.711029 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5823a8d3-90ff-4a1f-87a2-7016f425db70 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:21.711610 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5823a8d3-90ff-4a1f-87a2-7016f425db70 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:21.711942 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5823a8d3-90ff-4a1f-87a2-7016f425db70 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:21.712724 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5823a8d3-90ff-4a1f-87a2-7016f425db70 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:21.713171 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5823a8d3-90ff-4a1f-87a2-7016f425db70 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:21.713590 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5823a8d3-90ff-4a1f-87a2-7016f425db70 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:21.851453 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-5823a8d3-90ff-4a1f-87a2-7016f425db70 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:21.860089 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5823a8d3-90ff-4a1f-87a2-7016f425db70 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1676 microversion: 2.1 time: 0.159553 Aug 24 03:56:21.860663 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 266/526] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:21 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:21.893560 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-52283dc3-6d23-4c02-9361-019cfaa15590 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:21.894166 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-52283dc3-6d23-4c02-9361-019cfaa15590 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:21.900983 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-52283dc3-6d23-4c02-9361-019cfaa15590 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:21.901464 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-52283dc3-6d23-4c02-9361-019cfaa15590 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:21.901895 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-52283dc3-6d23-4c02-9361-019cfaa15590 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:21.902601 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-52283dc3-6d23-4c02-9361-019cfaa15590 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:21.903053 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-52283dc3-6d23-4c02-9361-019cfaa15590 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:21.903475 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-52283dc3-6d23-4c02-9361-019cfaa15590 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:22.057558 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-52283dc3-6d23-4c02-9361-019cfaa15590 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:22.064557 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-52283dc3-6d23-4c02-9361-019cfaa15590 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1754 microversion: 2.1 time: 0.175176 Aug 24 03:56:22.065145 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 261/527] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:21 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:22.159778 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bc4a3cb3-568d-475e-b6a5-5c23cc438b19 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:22.162038 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bc4a3cb3-568d-475e-b6a5-5c23cc438b19 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:22.168828 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bc4a3cb3-568d-475e-b6a5-5c23cc438b19 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:22.169311 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bc4a3cb3-568d-475e-b6a5-5c23cc438b19 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:22.176567 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bc4a3cb3-568d-475e-b6a5-5c23cc438b19 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:22.176567 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bc4a3cb3-568d-475e-b6a5-5c23cc438b19 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:22.176567 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bc4a3cb3-568d-475e-b6a5-5c23cc438b19 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:22.176567 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bc4a3cb3-568d-475e-b6a5-5c23cc438b19 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:22.200530 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bc4a3cb3-568d-475e-b6a5-5c23cc438b19 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044782 Aug 24 03:56:22.201092 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 267/528] 10.222.0.82 () {58 vars in 1302 bytes} [Wed Aug 24 03:56:22 2022] GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:56:22.882097 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-4fbacc32-4e67-4737-923d-c04230c08f20 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:22.882746 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-4fbacc32-4e67-4737-923d-c04230c08f20 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:22.889693 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4fbacc32-4e67-4737-923d-c04230c08f20 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:22.890177 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4fbacc32-4e67-4737-923d-c04230c08f20 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:22.890646 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4fbacc32-4e67-4737-923d-c04230c08f20 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:22.891333 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4fbacc32-4e67-4737-923d-c04230c08f20 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:22.891782 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4fbacc32-4e67-4737-923d-c04230c08f20 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:22.892198 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4fbacc32-4e67-4737-923d-c04230c08f20 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:23.027406 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-4fbacc32-4e67-4737-923d-c04230c08f20 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:23.035256 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-4fbacc32-4e67-4737-923d-c04230c08f20 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1676 microversion: 2.1 time: 0.157218 Aug 24 03:56:23.035824 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 262/529] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:22 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:23.093488 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e98504ab-476d-4225-bcf5-d1f82b9d11d9 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:23.093488 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e98504ab-476d-4225-bcf5-d1f82b9d11d9 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:23.095242 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e98504ab-476d-4225-bcf5-d1f82b9d11d9 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:23.095896 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e98504ab-476d-4225-bcf5-d1f82b9d11d9 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:23.096343 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e98504ab-476d-4225-bcf5-d1f82b9d11d9 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:23.097045 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e98504ab-476d-4225-bcf5-d1f82b9d11d9 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:23.097503 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e98504ab-476d-4225-bcf5-d1f82b9d11d9 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:23.097929 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e98504ab-476d-4225-bcf5-d1f82b9d11d9 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:23.213123 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-7e9e23f1-fa65-4e20-85b0-6fd10915b111 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:23.215527 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-7e9e23f1-fa65-4e20-85b0-6fd10915b111 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:23.222036 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7e9e23f1-fa65-4e20-85b0-6fd10915b111 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:23.222563 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7e9e23f1-fa65-4e20-85b0-6fd10915b111 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:23.223105 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7e9e23f1-fa65-4e20-85b0-6fd10915b111 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:23.223869 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7e9e23f1-fa65-4e20-85b0-6fd10915b111 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:23.224396 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7e9e23f1-fa65-4e20-85b0-6fd10915b111 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:23.224891 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7e9e23f1-fa65-4e20-85b0-6fd10915b111 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:23.246851 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-e98504ab-476d-4225-bcf5-d1f82b9d11d9 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:23.255634 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-7e9e23f1-fa65-4e20-85b0-6fd10915b111 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046586 Aug 24 03:56:23.256203 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 263/530] 10.222.0.82 () {58 vars in 1302 bytes} [Wed Aug 24 03:56:23 2022] GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:56:23.256334 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e98504ab-476d-4225-bcf5-d1f82b9d11d9 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1754 microversion: 2.1 time: 0.172600 Aug 24 03:56:23.262746 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 268/531] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:23 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:24.058228 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-e96e3ade-8a4e-45f1-84f0-b3acc84dddb5 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:24.058868 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-e96e3ade-8a4e-45f1-84f0-b3acc84dddb5 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:24.065005 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e96e3ade-8a4e-45f1-84f0-b3acc84dddb5 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:24.065574 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e96e3ade-8a4e-45f1-84f0-b3acc84dddb5 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:24.065900 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e96e3ade-8a4e-45f1-84f0-b3acc84dddb5 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:24.066769 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e96e3ade-8a4e-45f1-84f0-b3acc84dddb5 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:24.067069 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e96e3ade-8a4e-45f1-84f0-b3acc84dddb5 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:24.067480 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e96e3ade-8a4e-45f1-84f0-b3acc84dddb5 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:24.219091 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-e96e3ade-8a4e-45f1-84f0-b3acc84dddb5 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:24.226787 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-e96e3ade-8a4e-45f1-84f0-b3acc84dddb5 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1676 microversion: 2.1 time: 0.173847 Aug 24 03:56:24.227337 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 264/532] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:24 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1676 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:24.269477 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-610079d1-3423-4a06-83ac-edc129e93528 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:24.272371 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-610079d1-3423-4a06-83ac-edc129e93528 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:24.277897 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-3e62cf5f-4e82-4c3a-a71a-6dc65e79a617 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:24.278709 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-3e62cf5f-4e82-4c3a-a71a-6dc65e79a617 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:24.280532 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-610079d1-3423-4a06-83ac-edc129e93528 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:24.281361 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-610079d1-3423-4a06-83ac-edc129e93528 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:24.283094 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-610079d1-3423-4a06-83ac-edc129e93528 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:24.289022 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-610079d1-3423-4a06-83ac-edc129e93528 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:24.289624 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3e62cf5f-4e82-4c3a-a71a-6dc65e79a617 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:24.289737 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-610079d1-3423-4a06-83ac-edc129e93528 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:24.289829 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3e62cf5f-4e82-4c3a-a71a-6dc65e79a617 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:24.289918 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-610079d1-3423-4a06-83ac-edc129e93528 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:24.290019 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3e62cf5f-4e82-4c3a-a71a-6dc65e79a617 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:24.290019 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3e62cf5f-4e82-4c3a-a71a-6dc65e79a617 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:24.290019 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3e62cf5f-4e82-4c3a-a71a-6dc65e79a617 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:24.290019 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3e62cf5f-4e82-4c3a-a71a-6dc65e79a617 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:24.321329 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-610079d1-3423-4a06-83ac-edc129e93528 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055925 Aug 24 03:56:24.323371 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 269/533] 10.222.0.82 () {58 vars in 1302 bytes} [Wed Aug 24 03:56:24 2022] GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:56:24.329031 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ae83ed7e-0cc9-441d-94db-c4fc2671cdcf tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:56:24.331581 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ae83ed7e-0cc9-441d-94db-c4fc2671cdcf tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:24.339482 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ae83ed7e-0cc9-441d-94db-c4fc2671cdcf tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:24.340109 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ae83ed7e-0cc9-441d-94db-c4fc2671cdcf tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:24.340653 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ae83ed7e-0cc9-441d-94db-c4fc2671cdcf tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:24.341463 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ae83ed7e-0cc9-441d-94db-c4fc2671cdcf tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:24.342027 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ae83ed7e-0cc9-441d-94db-c4fc2671cdcf tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:24.344108 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ae83ed7e-0cc9-441d-94db-c4fc2671cdcf tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:24.371262 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-ae83ed7e-0cc9-441d-94db-c4fc2671cdcf tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lazy-loading 'flavor' on Instance uuid 95c868c4-fc26-429b-8f03-9edf2d7e8a70 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:56:24.477925 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-3e62cf5f-4e82-4c3a-a71a-6dc65e79a617 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:24.487320 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-3e62cf5f-4e82-4c3a-a71a-6dc65e79a617 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1754 microversion: 2.1 time: 0.213703 Aug 24 03:56:24.488055 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 265/534] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:24 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1754 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:56:24.655034 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ae83ed7e-0cc9-441d-94db-c4fc2671cdcf tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "POST /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70/action" status: 200 len: 32 microversion: 2.1 time: 0.330209 Aug 24 03:56:24.655635 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 270/535] 10.222.0.82 () {60 vars in 1278 bytes} [Wed Aug 24 03:56:24 2022] POST /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70/action => generated 32 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:56:24.665052 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-a25c5faf-a2d6-41e5-9275-27a746ff8cee tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:24.665656 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-a25c5faf-a2d6-41e5-9275-27a746ff8cee tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:24.671892 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a25c5faf-a2d6-41e5-9275-27a746ff8cee tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:24.672377 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a25c5faf-a2d6-41e5-9275-27a746ff8cee tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:24.672813 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a25c5faf-a2d6-41e5-9275-27a746ff8cee tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:24.673492 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a25c5faf-a2d6-41e5-9275-27a746ff8cee tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:24.673970 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a25c5faf-a2d6-41e5-9275-27a746ff8cee tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:24.674392 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a25c5faf-a2d6-41e5-9275-27a746ff8cee tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:24.823502 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-a25c5faf-a2d6-41e5-9275-27a746ff8cee tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:24.832387 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-a25c5faf-a2d6-41e5-9275-27a746ff8cee tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1733 microversion: 2.1 time: 0.171200 Aug 24 03:56:24.832957 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 266/536] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:24 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1733 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:25.249747 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5b7e0e83-fe28-431f-a9c0-de4d6ed90d85 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:25.250804 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5b7e0e83-fe28-431f-a9c0-de4d6ed90d85 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:25.256899 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b7e0e83-fe28-431f-a9c0-de4d6ed90d85 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:25.257377 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b7e0e83-fe28-431f-a9c0-de4d6ed90d85 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:25.257805 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b7e0e83-fe28-431f-a9c0-de4d6ed90d85 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:25.258487 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b7e0e83-fe28-431f-a9c0-de4d6ed90d85 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:25.258982 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b7e0e83-fe28-431f-a9c0-de4d6ed90d85 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:25.260284 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b7e0e83-fe28-431f-a9c0-de4d6ed90d85 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:25.334767 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-cd6c5b12-4d93-4b0c-b9e8-0f5eea30afa8 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:25.337067 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-cd6c5b12-4d93-4b0c-b9e8-0f5eea30afa8 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:25.357292 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cd6c5b12-4d93-4b0c-b9e8-0f5eea30afa8 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:25.357793 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cd6c5b12-4d93-4b0c-b9e8-0f5eea30afa8 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:25.358238 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cd6c5b12-4d93-4b0c-b9e8-0f5eea30afa8 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:25.358969 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cd6c5b12-4d93-4b0c-b9e8-0f5eea30afa8 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:25.359490 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cd6c5b12-4d93-4b0c-b9e8-0f5eea30afa8 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:25.360382 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cd6c5b12-4d93-4b0c-b9e8-0f5eea30afa8 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:25.407791 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-cd6c5b12-4d93-4b0c-b9e8-0f5eea30afa8 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077022 Aug 24 03:56:25.408387 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 267/537] 10.222.0.82 () {58 vars in 1302 bytes} [Wed Aug 24 03:56:25 2022] GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 03:56:25.507745 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-3bc73f01-ddb3-4e78-845b-b8b16f423db6 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:25.508237 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-3bc73f01-ddb3-4e78-845b-b8b16f423db6 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:25.516594 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3bc73f01-ddb3-4e78-845b-b8b16f423db6 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:25.525730 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3bc73f01-ddb3-4e78-845b-b8b16f423db6 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:25.525730 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3bc73f01-ddb3-4e78-845b-b8b16f423db6 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:25.525730 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3bc73f01-ddb3-4e78-845b-b8b16f423db6 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:25.525730 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3bc73f01-ddb3-4e78-845b-b8b16f423db6 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:25.526120 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3bc73f01-ddb3-4e78-845b-b8b16f423db6 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:25.534899 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-5b7e0e83-fe28-431f-a9c0-de4d6ed90d85 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:25.544556 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5b7e0e83-fe28-431f-a9c0-de4d6ed90d85 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1676 microversion: 2.1 time: 0.298923 Aug 24 03:56:25.545144 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 271/538] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:25 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1676 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:25.550165 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f07a65cc-ed9a-4b32-b3da-b23a68be8174 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:25.550813 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f07a65cc-ed9a-4b32-b3da-b23a68be8174 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:25.555412 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-3bc73f01-ddb3-4e78-845b-b8b16f423db6 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Going to try to terminate instance {{(pid=127869) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:56:25.558540 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f07a65cc-ed9a-4b32-b3da-b23a68be8174 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:25.562998 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f07a65cc-ed9a-4b32-b3da-b23a68be8174 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:25.563445 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f07a65cc-ed9a-4b32-b3da-b23a68be8174 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:25.564158 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f07a65cc-ed9a-4b32-b3da-b23a68be8174 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:25.564611 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f07a65cc-ed9a-4b32-b3da-b23a68be8174 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:25.565036 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f07a65cc-ed9a-4b32-b3da-b23a68be8174 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:25.753336 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-f07a65cc-ed9a-4b32-b3da-b23a68be8174 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:25.763506 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f07a65cc-ed9a-4b32-b3da-b23a68be8174 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1754 microversion: 2.1 time: 0.217386 Aug 24 03:56:25.764178 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 272/539] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:25 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1754 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:25.853391 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-037af200-0937-49d2-af65-130b022022a5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:25.854293 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-037af200-0937-49d2-af65-130b022022a5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:25.860045 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-037af200-0937-49d2-af65-130b022022a5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:25.860522 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-037af200-0937-49d2-af65-130b022022a5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:25.860959 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-037af200-0937-49d2-af65-130b022022a5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:25.861753 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-037af200-0937-49d2-af65-130b022022a5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:25.862200 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-037af200-0937-49d2-af65-130b022022a5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:25.862650 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-037af200-0937-49d2-af65-130b022022a5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:25.896312 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-3bc73f01-ddb3-4e78-845b-b8b16f423db6 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "DELETE /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b" status: 204 len: 0 microversion: 2.1 time: 0.392843 Aug 24 03:56:25.898599 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 268/540] 10.222.0.82 () {58 vars in 1239 bytes} [Wed Aug 24 03:56:25 2022] DELETE /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:56:25.906893 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-10d712d8-eba2-42fd-b2e2-6e809b67f223 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:25.907589 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-10d712d8-eba2-42fd-b2e2-6e809b67f223 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:25.913563 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-10d712d8-eba2-42fd-b2e2-6e809b67f223 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:25.914035 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-10d712d8-eba2-42fd-b2e2-6e809b67f223 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:25.914465 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-10d712d8-eba2-42fd-b2e2-6e809b67f223 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:25.915180 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-10d712d8-eba2-42fd-b2e2-6e809b67f223 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:25.915659 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-10d712d8-eba2-42fd-b2e2-6e809b67f223 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:25.916105 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-10d712d8-eba2-42fd-b2e2-6e809b67f223 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:26.024034 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-037af200-0937-49d2-af65-130b022022a5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:26.032470 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-037af200-0937-49d2-af65-130b022022a5 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1733 microversion: 2.1 time: 0.183090 Aug 24 03:56:26.033058 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 273/541] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:25 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1733 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:26.065878 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-10d712d8-eba2-42fd-b2e2-6e809b67f223 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:26.075169 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-10d712d8-eba2-42fd-b2e2-6e809b67f223 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b" status: 200 len: 1684 microversion: 2.1 time: 0.172282 Aug 24 03:56:26.089124 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 269/542] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:25 2022] GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b => generated 1684 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:56:26.565987 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-785c2873-9b35-408d-8824-55a59f61739a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:26.566635 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-785c2873-9b35-408d-8824-55a59f61739a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:26.574749 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-785c2873-9b35-408d-8824-55a59f61739a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:26.575432 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-785c2873-9b35-408d-8824-55a59f61739a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:26.576461 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-785c2873-9b35-408d-8824-55a59f61739a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:26.577359 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-785c2873-9b35-408d-8824-55a59f61739a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:26.577890 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-785c2873-9b35-408d-8824-55a59f61739a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:26.578314 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-785c2873-9b35-408d-8824-55a59f61739a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:26.729994 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-785c2873-9b35-408d-8824-55a59f61739a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:26.737768 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-785c2873-9b35-408d-8824-55a59f61739a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1676 microversion: 2.1 time: 0.176067 Aug 24 03:56:26.738343 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 274/543] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:26 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1676 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:26.786531 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-1870b8e2-287b-445f-9299-6213caf9e2be tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:26.787135 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-1870b8e2-287b-445f-9299-6213caf9e2be tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:26.794102 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1870b8e2-287b-445f-9299-6213caf9e2be tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:26.794527 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1870b8e2-287b-445f-9299-6213caf9e2be tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:26.794965 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1870b8e2-287b-445f-9299-6213caf9e2be tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:26.795656 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1870b8e2-287b-445f-9299-6213caf9e2be tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:26.796248 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1870b8e2-287b-445f-9299-6213caf9e2be tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:26.796586 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1870b8e2-287b-445f-9299-6213caf9e2be tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:26.957172 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-1870b8e2-287b-445f-9299-6213caf9e2be tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:26.965913 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-1870b8e2-287b-445f-9299-6213caf9e2be tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1757 microversion: 2.1 time: 0.183084 Aug 24 03:56:26.966497 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 270/544] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:26 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1757 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:27.053381 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ccc01b22-0423-4cd0-a990-dfaf763ae853 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:27.054003 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ccc01b22-0423-4cd0-a990-dfaf763ae853 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:27.060570 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ccc01b22-0423-4cd0-a990-dfaf763ae853 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:27.061053 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ccc01b22-0423-4cd0-a990-dfaf763ae853 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:27.061489 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ccc01b22-0423-4cd0-a990-dfaf763ae853 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:27.062176 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ccc01b22-0423-4cd0-a990-dfaf763ae853 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:27.062728 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ccc01b22-0423-4cd0-a990-dfaf763ae853 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:27.063155 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ccc01b22-0423-4cd0-a990-dfaf763ae853 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:27.096387 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-9a0bfe5f-e622-4855-b0e0-9beb162a8750 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:27.097100 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-9a0bfe5f-e622-4855-b0e0-9beb162a8750 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:27.103723 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9a0bfe5f-e622-4855-b0e0-9beb162a8750 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:27.104264 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9a0bfe5f-e622-4855-b0e0-9beb162a8750 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:27.104689 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9a0bfe5f-e622-4855-b0e0-9beb162a8750 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:27.105390 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9a0bfe5f-e622-4855-b0e0-9beb162a8750 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:27.105820 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9a0bfe5f-e622-4855-b0e0-9beb162a8750 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:27.106228 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9a0bfe5f-e622-4855-b0e0-9beb162a8750 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:27.195869 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-ccc01b22-0423-4cd0-a990-dfaf763ae853 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:27.199778 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:27.204911 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ccc01b22-0423-4cd0-a990-dfaf763ae853 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1733 microversion: 2.1 time: 0.155551 Aug 24 03:56:27.205428 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 275/545] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:27 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:27.239098 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-9a0bfe5f-e622-4855-b0e0-9beb162a8750 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:27.247462 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-9a0bfe5f-e622-4855-b0e0-9beb162a8750 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b" status: 200 len: 1684 microversion: 2.1 time: 0.154864 Aug 24 03:56:27.248024 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 271/546] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:27 2022] GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:56:27.760963 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e70d076d-8caa-4ed5-b7e4-72d5870dd6bd tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:27.761573 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e70d076d-8caa-4ed5-b7e4-72d5870dd6bd tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:27.768337 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e70d076d-8caa-4ed5-b7e4-72d5870dd6bd tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:27.768816 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e70d076d-8caa-4ed5-b7e4-72d5870dd6bd tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:27.769252 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e70d076d-8caa-4ed5-b7e4-72d5870dd6bd tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:27.769939 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e70d076d-8caa-4ed5-b7e4-72d5870dd6bd tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:27.770395 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e70d076d-8caa-4ed5-b7e4-72d5870dd6bd tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:27.770842 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e70d076d-8caa-4ed5-b7e4-72d5870dd6bd tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:27.914817 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-e70d076d-8caa-4ed5-b7e4-72d5870dd6bd tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:27.922609 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e70d076d-8caa-4ed5-b7e4-72d5870dd6bd tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1676 microversion: 2.1 time: 0.166603 Aug 24 03:56:27.923176 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 276/547] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:27 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:28.225483 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-e8ad1550-d269-4b9f-800c-500ecd524286 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:28.226082 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-e8ad1550-d269-4b9f-800c-500ecd524286 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:28.233213 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e8ad1550-d269-4b9f-800c-500ecd524286 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:28.233691 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e8ad1550-d269-4b9f-800c-500ecd524286 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:28.234126 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e8ad1550-d269-4b9f-800c-500ecd524286 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:28.234841 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e8ad1550-d269-4b9f-800c-500ecd524286 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:28.235293 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e8ad1550-d269-4b9f-800c-500ecd524286 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:28.235743 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e8ad1550-d269-4b9f-800c-500ecd524286 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:28.268782 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d9bf9870-b628-4c7c-ade5-452d23fdbb3a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:28.269483 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d9bf9870-b628-4c7c-ade5-452d23fdbb3a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:28.276363 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d9bf9870-b628-4c7c-ade5-452d23fdbb3a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:28.276843 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d9bf9870-b628-4c7c-ade5-452d23fdbb3a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:28.277341 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d9bf9870-b628-4c7c-ade5-452d23fdbb3a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:28.278105 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d9bf9870-b628-4c7c-ade5-452d23fdbb3a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:28.278662 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d9bf9870-b628-4c7c-ade5-452d23fdbb3a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:28.279086 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d9bf9870-b628-4c7c-ade5-452d23fdbb3a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:28.376892 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-e8ad1550-d269-4b9f-800c-500ecd524286 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:28.385887 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-e8ad1550-d269-4b9f-800c-500ecd524286 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1733 microversion: 2.1 time: 0.164151 Aug 24 03:56:28.386960 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 272/548] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:28 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1733 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:28.460272 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-d9bf9870-b628-4c7c-ade5-452d23fdbb3a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:28.468450 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d9bf9870-b628-4c7c-ade5-452d23fdbb3a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b" status: 200 len: 1684 microversion: 2.1 time: 0.203679 Aug 24 03:56:28.469014 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 277/549] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:28 2022] GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b => generated 1684 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:56:28.943760 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-eca088be-f22b-4242-9938-6910d8bdd139 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:28.944516 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-eca088be-f22b-4242-9938-6910d8bdd139 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:28.951896 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-eca088be-f22b-4242-9938-6910d8bdd139 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:28.952375 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-eca088be-f22b-4242-9938-6910d8bdd139 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:28.952830 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-eca088be-f22b-4242-9938-6910d8bdd139 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:28.953509 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-eca088be-f22b-4242-9938-6910d8bdd139 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:28.953950 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-eca088be-f22b-4242-9938-6910d8bdd139 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:28.954455 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-eca088be-f22b-4242-9938-6910d8bdd139 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:29.085669 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-eca088be-f22b-4242-9938-6910d8bdd139 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:29.093552 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-eca088be-f22b-4242-9938-6910d8bdd139 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1653 microversion: 2.1 time: 0.153624 Aug 24 03:56:29.094219 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 273/550] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:28 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1653 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:29.115217 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-584ddc37-a212-4304-b155-6321b68042b4 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:56:29.123528 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-584ddc37-a212-4304-b155-6321b68042b4 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:29.124019 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-584ddc37-a212-4304-b155-6321b68042b4 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:29.124450 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-584ddc37-a212-4304-b155-6321b68042b4 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:29.157668 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-584ddc37-a212-4304-b155-6321b68042b4 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Going to try to start instance {{(pid=127870) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 03:56:29.419608 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-79c0f487-48e7-44c1-a96a-e228a5dd4b77 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:29.422809 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-79c0f487-48e7-44c1-a96a-e228a5dd4b77 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:29.426291 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-584ddc37-a212-4304-b155-6321b68042b4 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "POST /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6/action" status: 202 len: 0 microversion: 2.1 time: 0.315235 Aug 24 03:56:29.426976 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 278/551] 10.222.0.82 () {60 vars in 1278 bytes} [Wed Aug 24 03:56:29 2022] POST /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:56:29.436208 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-a525a93c-f8ad-4e07-849d-7b858081eb71 req-f53fa0f0-be22-46b3-b543-9dd6d7a1e535 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd0bdd49-e4b5-4819-91f5-399d77f4dd4b", "name": "network-vif-deleted", "tag": "b3a05365-20ef-4b17-b002-533b96739ce0"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:56:29.438016 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-79c0f487-48e7-44c1-a96a-e228a5dd4b77 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:29.438171 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-79c0f487-48e7-44c1-a96a-e228a5dd4b77 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:29.438694 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-79c0f487-48e7-44c1-a96a-e228a5dd4b77 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:29.439596 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-79c0f487-48e7-44c1-a96a-e228a5dd4b77 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:29.440118 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-79c0f487-48e7-44c1-a96a-e228a5dd4b77 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:29.440758 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-79c0f487-48e7-44c1-a96a-e228a5dd4b77 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:29.448587 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-a525a93c-f8ad-4e07-849d-7b858081eb71 req-f53fa0f0-be22-46b3-b543-9dd6d7a1e535 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:29.449066 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-a525a93c-f8ad-4e07-849d-7b858081eb71 req-f53fa0f0-be22-46b3-b543-9dd6d7a1e535 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:29.449506 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-a525a93c-f8ad-4e07-849d-7b858081eb71 req-f53fa0f0-be22-46b3-b543-9dd6d7a1e535 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:29.461428 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-a525a93c-f8ad-4e07-849d-7b858081eb71 req-f53fa0f0-be22-46b3-b543-9dd6d7a1e535 service nova] Creating event network-vif-deleted:b3a05365-20ef-4b17-b002-533b96739ce0 for instance dd0bdd49-e4b5-4819-91f5-399d77f4dd4b on hv-cinder-85426 Aug 24 03:56:29.467416 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-a525a93c-f8ad-4e07-849d-7b858081eb71 req-f53fa0f0-be22-46b3-b543-9dd6d7a1e535 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039255 Aug 24 03:56:29.468304 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 279/552] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:56:29.475220 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-78407833-7914-4d0a-9bc0-8f05f2f6a7ff tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:29.476322 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-78407833-7914-4d0a-9bc0-8f05f2f6a7ff tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:29.484925 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:29.486012 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-78407833-7914-4d0a-9bc0-8f05f2f6a7ff tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:29.486377 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-78407833-7914-4d0a-9bc0-8f05f2f6a7ff tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:29.486850 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-78407833-7914-4d0a-9bc0-8f05f2f6a7ff tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:29.487572 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-78407833-7914-4d0a-9bc0-8f05f2f6a7ff tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:29.488027 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-78407833-7914-4d0a-9bc0-8f05f2f6a7ff tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:29.488450 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-78407833-7914-4d0a-9bc0-8f05f2f6a7ff tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:29.664922 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-79c0f487-48e7-44c1-a96a-e228a5dd4b77 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:29.667897 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-78407833-7914-4d0a-9bc0-8f05f2f6a7ff tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:29.675778 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-79c0f487-48e7-44c1-a96a-e228a5dd4b77 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1733 microversion: 2.1 time: 0.266848 Aug 24 03:56:29.677808 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-78407833-7914-4d0a-9bc0-8f05f2f6a7ff tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1662 microversion: 2.1 time: 0.208311 Aug 24 03:56:29.678683 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 280/553] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:29 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1662 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:29.689551 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4a60b5bc-e0fb-495f-aae6-2ddfc7b3efac tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:29.690422 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4a60b5bc-e0fb-495f-aae6-2ddfc7b3efac tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:29.691361 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 274/554] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:29 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1733 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:29.702825 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4a60b5bc-e0fb-495f-aae6-2ddfc7b3efac tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:29.703406 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4a60b5bc-e0fb-495f-aae6-2ddfc7b3efac tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:29.704048 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4a60b5bc-e0fb-495f-aae6-2ddfc7b3efac tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:29.705286 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4a60b5bc-e0fb-495f-aae6-2ddfc7b3efac tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:29.705916 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4a60b5bc-e0fb-495f-aae6-2ddfc7b3efac tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:29.706842 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4a60b5bc-e0fb-495f-aae6-2ddfc7b3efac tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:29.800015 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-4a60b5bc-e0fb-495f-aae6-2ddfc7b3efac tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:29.809130 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4a60b5bc-e0fb-495f-aae6-2ddfc7b3efac tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b" status: 200 len: 1327 microversion: 2.1 time: 0.129268 Aug 24 03:56:29.809706 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 281/555] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:29 2022] GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b => generated 1327 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:30.698242 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-89bc45d0-d9bd-47af-b13f-4bc458d3bb26 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:30.783558 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-89bc45d0-d9bd-47af-b13f-4bc458d3bb26 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:30.784211 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e8d1314e-aeef-4833-8d64-70900cff19f5 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:30.784211 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e8d1314e-aeef-4833-8d64-70900cff19f5 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:30.784908 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-89bc45d0-d9bd-47af-b13f-4bc458d3bb26 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:30.784908 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-89bc45d0-d9bd-47af-b13f-4bc458d3bb26 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:30.784908 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-89bc45d0-d9bd-47af-b13f-4bc458d3bb26 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:30.784908 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-89bc45d0-d9bd-47af-b13f-4bc458d3bb26 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:30.785231 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-89bc45d0-d9bd-47af-b13f-4bc458d3bb26 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:30.785231 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-89bc45d0-d9bd-47af-b13f-4bc458d3bb26 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:30.785385 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8d1314e-aeef-4833-8d64-70900cff19f5 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:30.785385 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8d1314e-aeef-4833-8d64-70900cff19f5 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:30.785385 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8d1314e-aeef-4833-8d64-70900cff19f5 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:30.785385 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8d1314e-aeef-4833-8d64-70900cff19f5 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:30.785706 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8d1314e-aeef-4833-8d64-70900cff19f5 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:30.785706 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e8d1314e-aeef-4833-8d64-70900cff19f5 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:30.846560 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-89bc45d0-d9bd-47af-b13f-4bc458d3bb26 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:30.856354 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-89bc45d0-d9bd-47af-b13f-4bc458d3bb26 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1733 microversion: 2.1 time: 0.163038 Aug 24 03:56:30.857113 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 275/556] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:30 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:30.861651 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-e8d1314e-aeef-4833-8d64-70900cff19f5 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:30.861964 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-e72aa8d3-9094-4b7b-9a37-184e3ef57bac tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:30.862596 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-e72aa8d3-9094-4b7b-9a37-184e3ef57bac tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:30.870739 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e8d1314e-aeef-4833-8d64-70900cff19f5 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1662 microversion: 2.1 time: 0.172351 Aug 24 03:56:30.871328 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 282/557] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:30 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1662 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:30.874327 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e72aa8d3-9094-4b7b-9a37-184e3ef57bac tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:30.874935 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e72aa8d3-9094-4b7b-9a37-184e3ef57bac tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:30.875550 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e72aa8d3-9094-4b7b-9a37-184e3ef57bac tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:30.876297 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e72aa8d3-9094-4b7b-9a37-184e3ef57bac tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:30.876751 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e72aa8d3-9094-4b7b-9a37-184e3ef57bac tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:30.877187 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e72aa8d3-9094-4b7b-9a37-184e3ef57bac tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:30.908524 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e72aa8d3-9094-4b7b-9a37-184e3ef57bac tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:30.909002 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e72aa8d3-9094-4b7b-9a37-184e3ef57bac tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:30.909435 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e72aa8d3-9094-4b7b-9a37-184e3ef57bac tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:30.909880 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.objects.instance [None req-e72aa8d3-9094-4b7b-9a37-184e3ef57bac tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lazy-loading 'fault' on Instance uuid dd0bdd49-e4b5-4819-91f5-399d77f4dd4b {{(pid=127869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:56:30.951537 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-e72aa8d3-9094-4b7b-9a37-184e3ef57bac tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:30.959241 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-e72aa8d3-9094-4b7b-9a37-184e3ef57bac tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b" status: 200 len: 1332 microversion: 2.1 time: 0.100919 Aug 24 03:56:30.959794 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 276/558] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:30 2022] GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b => generated 1332 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:31.881307 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-20e8112c-2ef0-4fb6-905a-361367e85a80 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:31.881945 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-20e8112c-2ef0-4fb6-905a-361367e85a80 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:31.893605 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-8f653dc9-d8ed-4fe8-a735-09aa3ce4b504 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:31.894235 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-8f653dc9-d8ed-4fe8-a735-09aa3ce4b504 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:31.894350 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-20e8112c-2ef0-4fb6-905a-361367e85a80 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:31.895182 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-20e8112c-2ef0-4fb6-905a-361367e85a80 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:31.895986 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-20e8112c-2ef0-4fb6-905a-361367e85a80 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:31.897239 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-20e8112c-2ef0-4fb6-905a-361367e85a80 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:31.898250 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-20e8112c-2ef0-4fb6-905a-361367e85a80 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:31.899070 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-20e8112c-2ef0-4fb6-905a-361367e85a80 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:31.902237 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8f653dc9-d8ed-4fe8-a735-09aa3ce4b504 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:31.902749 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8f653dc9-d8ed-4fe8-a735-09aa3ce4b504 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:31.903192 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8f653dc9-d8ed-4fe8-a735-09aa3ce4b504 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:31.903877 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8f653dc9-d8ed-4fe8-a735-09aa3ce4b504 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:31.904350 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8f653dc9-d8ed-4fe8-a735-09aa3ce4b504 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:31.904771 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8f653dc9-d8ed-4fe8-a735-09aa3ce4b504 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:32.044106 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-8f653dc9-d8ed-4fe8-a735-09aa3ce4b504 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:32.049590 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-20e8112c-2ef0-4fb6-905a-361367e85a80 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:32.052218 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-8f653dc9-d8ed-4fe8-a735-09aa3ce4b504 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1666 microversion: 2.1 time: 0.162520 Aug 24 03:56:32.054808 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 277/559] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:31 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1666 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:56:32.057983 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-d8a15eb0-5c6c-4672-ae64-0a80fbe30079 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:32.058723 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-d8a15eb0-5c6c-4672-ae64-0a80fbe30079 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:32.065121 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d8a15eb0-5c6c-4672-ae64-0a80fbe30079 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:32.065845 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d8a15eb0-5c6c-4672-ae64-0a80fbe30079 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:32.066351 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d8a15eb0-5c6c-4672-ae64-0a80fbe30079 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:32.067301 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-20e8112c-2ef0-4fb6-905a-361367e85a80 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1733 microversion: 2.1 time: 0.189865 Aug 24 03:56:32.067548 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d8a15eb0-5c6c-4672-ae64-0a80fbe30079 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:32.067881 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 283/560] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:31 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1733 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:32.068014 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d8a15eb0-5c6c-4672-ae64-0a80fbe30079 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:32.068419 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d8a15eb0-5c6c-4672-ae64-0a80fbe30079 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:32.082735 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.wsgi [None req-d8a15eb0-5c6c-4672-ae64-0a80fbe30079 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] HTTP exception thrown: Instance dd0bdd49-e4b5-4819-91f5-399d77f4dd4b could not be found. Aug 24 03:56:32.084369 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-d8a15eb0-5c6c-4672-ae64-0a80fbe30079 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Request method failure captured: Aug 24 03:56:32.084369 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: request: GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b HTTP/1.1 Aug 24 03:56:32.084369 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept: application/json Aug 24 03:56:32.084369 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept-Encoding: identity Aug 24 03:56:32.084369 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Connection: close Aug 24 03:56:32.084369 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Length: 0 Aug 24 03:56:32.084369 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Type: application/json Aug 24 03:56:32.084369 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Host: 10.222.0.82 Aug 24 03:56:32.084369 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Openstack-System-Scope: None Aug 24 03:56:32.084369 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: User-Agent: python-urllib3/1.26.11 Aug 24 03:56:32.084369 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Auth-Token: gAAAAABjBaByYUQ7dP595ip40_OJ_0ufC71Rc-FPYS4vZXmmx4Fislhg9iz6FfvLLHiwJ4Ed0bFNDX6fhqS1zmk_A3EKqVLHT9Pz2gZaaIcE0OalzJoOw2sqfwO-7iDYasbxHIEhvzvTJNavoRaspbu_b6_R5EZ70Pa8SKRgBtFA8vqfpAdszSk Aug 24 03:56:32.084369 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Id: None Aug 24 03:56:32.084369 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Name: None Aug 24 03:56:32.084369 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Identity-Status: Confirmed Aug 24 03:56:32.084369 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Is-Admin-Project: True Aug 24 03:56:32.084369 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Id: default Aug 24 03:56:32.084369 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Name: Default Aug 24 03:56:32.084369 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Id: 46ef5b02d8da4d2eac26b6ccfb35e1a4 Aug 24 03:56:32.084369 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Name: tempest-AttachVolumeNegativeTest-477133645 Aug 24 03:56:32.084369 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Role: member,reader Aug 24 03:56:32.084369 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Roles: member,reader Aug 24 03:56:32.085987 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/46ef5b02d8da4d2eac26b6ccfb35e1a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/46ef5b02d8da4d2eac26b6ccfb35e1a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/46ef5b02d8da4d2eac26b6ccfb35e1a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_46ef5b02d8da4d2eac26b6ccfb35e1a4", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:56:32.085987 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant: tempest-AttachVolumeNegativeTest-477133645 Aug 24 03:56:32.085987 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Id: 46ef5b02d8da4d2eac26b6ccfb35e1a4 Aug 24 03:56:32.085987 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-477133645 Aug 24 03:56:32.085987 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User: tempest-AttachVolumeNegativeTest-477133645-project Aug 24 03:56:32.085987 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Id: default Aug 24 03:56:32.085987 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Name: Default Aug 24 03:56:32.085987 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Id: e5582d10ebef459084fe287c18568f98 Aug 24 03:56:32.085987 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Name: tempest-AttachVolumeNegativeTest-477133645-project Aug 24 03:56:32.085987 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: method: > Aug 24 03:56:32.085987 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: exception: Instance dd0bdd49-e4b5-4819-91f5-399d77f4dd4b could not be found. Aug 24 03:56:32.085987 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: action_args: {'id': 'dd0bdd49-e4b5-4819-91f5-399d77f4dd4b'} Aug 24 03:56:32.087424 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:56:32.087424 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:56:32.087424 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:56:32.087424 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:56:32.087424 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:56:32.087424 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:56:32.087424 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:56:32.087424 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:56:32.087424 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:56:32.087424 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:56:32.087424 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd0bdd49-e4b5-4819-91f5-399d77f4dd4b could not be found. Aug 24 03:56:32.087424 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:56:32.087424 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:56:32.087424 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:56:32.087424 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:56:32.087424 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:56:32.087424 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:56:32.087424 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:56:32.087424 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:56:32.087424 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:56:32.089022 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:56:32.089022 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:56:32.089022 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:56:32.089022 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:56:32.089022 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:56:32.089022 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:56:32.089022 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:56:32.089022 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd0bdd49-e4b5-4819-91f5-399d77f4dd4b could not be found. Aug 24 03:56:32.089022 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:56:32.089022 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:56:32.089022 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:56:32.089022 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:56:32.089022 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:56:32.089022 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:56:32.089022 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:56:32.089022 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:56:32.089022 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd0bdd49-e4b5-4819-91f5-399d77f4dd4b could not be found. Aug 24 03:56:32.089022 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:56:32.090381 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-d8a15eb0-5c6c-4672-ae64-0a80fbe30079 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Returning 404 to user: Instance dd0bdd49-e4b5-4819-91f5-399d77f4dd4b could not be found. {{(pid=127869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:56:32.090381 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-d8a15eb0-5c6c-4672-ae64-0a80fbe30079 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b" status: 404 len: 111 microversion: 2.1 time: 0.032033 Aug 24 03:56:32.090381 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 278/561] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:32 2022] GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:56:32.095627 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7ed71760-8f04-4a3c-b4d0-2fc9fa46ad8b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '.version_select at 0x7f155416ea60>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:32.263356 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7ed71760-8f04-4a3c-b4d0-2fc9fa46ad8b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1981082489" status: 202 len: 0 microversion: 2.1 time: 0.171513 Aug 24 03:56:32.263940 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 284/562] 10.222.0.82 () {58 vars in 1221 bytes} [Wed Aug 24 03:56:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1981082489 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:56:33.034438 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-9142e6b0-0c0e-4780-aebe-6dce0560675b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Action: 'create', calling method: .version_select at 0x7f1554353160>, body: {"keypair": {"name": "tempest-keypair-696726489", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+MUyk81tUwyGCY6lMaETLlpzJUUd84QE3WPk4hy9XjKUf1xA3VHh2RIURucocLgl99uccA+bhbg62eGwYRfRn8A/mQ5twgidod7l1oa81upvZNNWA0Fn4aHVerKBRFcA=="}} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:56:33.050427 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.quota [None req-9142e6b0-0c0e-4780-aebe-6dce0560675b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Getting quotas for project 46ef5b02d8da4d2eac26b6ccfb35e1a4. Resources: {'key_pairs'} {{(pid=127869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:56:33.054421 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.quota [None req-9142e6b0-0c0e-4780-aebe-6dce0560675b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Getting quotas for user e5582d10ebef459084fe287c18568f98 and project 46ef5b02d8da4d2eac26b6ccfb35e1a4. Resources: {'key_pairs'} {{(pid=127869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:56:33.089603 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-aa7d4b64-a4a0-49d5-9216-65004edd9527 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:33.090233 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-aa7d4b64-a4a0-49d5-9216-65004edd9527 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:33.096827 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aa7d4b64-a4a0-49d5-9216-65004edd9527 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:33.097308 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aa7d4b64-a4a0-49d5-9216-65004edd9527 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:33.097748 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aa7d4b64-a4a0-49d5-9216-65004edd9527 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:33.098438 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aa7d4b64-a4a0-49d5-9216-65004edd9527 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:33.098928 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aa7d4b64-a4a0-49d5-9216-65004edd9527 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:33.099408 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-aa7d4b64-a4a0-49d5-9216-65004edd9527 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:33.131352 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-9142e6b0-0c0e-4780-aebe-6dce0560675b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.100874 Aug 24 03:56:33.131942 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 279/563] 10.222.0.82 () {60 vars in 1159 bytes} [Wed Aug 24 03:56:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:56:33.232063 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-aa7d4b64-a4a0-49d5-9216-65004edd9527 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:33.240506 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-aa7d4b64-a4a0-49d5-9216-65004edd9527 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1733 microversion: 2.1 time: 0.155459 Aug 24 03:56:33.241083 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 285/564] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:33 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:56:34.263538 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-243d84e4-e23b-4a7b-ad7d-fe90e54b8b17 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:34.264147 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-243d84e4-e23b-4a7b-ad7d-fe90e54b8b17 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:34.271924 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-243d84e4-e23b-4a7b-ad7d-fe90e54b8b17 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:34.273283 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-243d84e4-e23b-4a7b-ad7d-fe90e54b8b17 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:34.273283 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-243d84e4-e23b-4a7b-ad7d-fe90e54b8b17 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:34.273567 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-243d84e4-e23b-4a7b-ad7d-fe90e54b8b17 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:34.274017 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-243d84e4-e23b-4a7b-ad7d-fe90e54b8b17 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:34.275547 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-243d84e4-e23b-4a7b-ad7d-fe90e54b8b17 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:34.411982 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-243d84e4-e23b-4a7b-ad7d-fe90e54b8b17 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:34.420967 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-243d84e4-e23b-4a7b-ad7d-fe90e54b8b17 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1733 microversion: 2.1 time: 0.162255 Aug 24 03:56:34.422527 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 280/565] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:34 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:35.343717 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b1cb942c-5ef3-429f-9221-7b75b173b254 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:35.344300 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b1cb942c-5ef3-429f-9221-7b75b173b254 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:35.350822 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b1cb942c-5ef3-429f-9221-7b75b173b254 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:35.351306 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b1cb942c-5ef3-429f-9221-7b75b173b254 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:35.351749 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b1cb942c-5ef3-429f-9221-7b75b173b254 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:35.353028 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b1cb942c-5ef3-429f-9221-7b75b173b254 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:35.353561 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b1cb942c-5ef3-429f-9221-7b75b173b254 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:35.353991 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b1cb942c-5ef3-429f-9221-7b75b173b254 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:35.384305 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b1cb942c-5ef3-429f-9221-7b75b173b254 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7/os-volume_attachments/b50fd527-c6d8-4e0d-92bd-857ebfcad8ea" status: 200 len: 194 microversion: 2.20 time: 0.044223 Aug 24 03:56:35.384914 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 286/566] 10.222.0.82 () {60 vars in 1454 bytes} [Wed Aug 24 03:56:35 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7/os-volume_attachments/b50fd527-c6d8-4e0d-92bd-857ebfcad8ea => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:56:35.442482 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-5f09578f-7ab0-4932-bd69-5d2896fd1764 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:35.443208 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-5f09578f-7ab0-4932-bd69-5d2896fd1764 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:35.450481 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5f09578f-7ab0-4932-bd69-5d2896fd1764 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:35.451007 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5f09578f-7ab0-4932-bd69-5d2896fd1764 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:35.458042 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5f09578f-7ab0-4932-bd69-5d2896fd1764 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:35.458042 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5f09578f-7ab0-4932-bd69-5d2896fd1764 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:35.458042 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5f09578f-7ab0-4932-bd69-5d2896fd1764 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:35.458042 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5f09578f-7ab0-4932-bd69-5d2896fd1764 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:35.458429 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-25f11eec-ebe9-4967-9315-afff6bab71c9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:35.458429 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-25f11eec-ebe9-4967-9315-afff6bab71c9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:35.460522 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-25f11eec-ebe9-4967-9315-afff6bab71c9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:35.461004 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-25f11eec-ebe9-4967-9315-afff6bab71c9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:35.461523 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-25f11eec-ebe9-4967-9315-afff6bab71c9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:35.462400 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-25f11eec-ebe9-4967-9315-afff6bab71c9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:35.462900 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-25f11eec-ebe9-4967-9315-afff6bab71c9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:35.463325 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-25f11eec-ebe9-4967-9315-afff6bab71c9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:35.555026 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-25f11eec-ebe9-4967-9315-afff6bab71c9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lazy-loading 'services' on Instance uuid b8b22210-7e08-4f01-bf00-d84b0e5e34d7 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:56:35.601759 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-5f09578f-7ab0-4932-bd69-5d2896fd1764 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:35.611671 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-5f09578f-7ab0-4932-bd69-5d2896fd1764 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1733 microversion: 2.1 time: 0.173196 Aug 24 03:56:35.612709 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 281/567] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:35 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1733 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:35.632272 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-80d79969-49fc-4470-a79e-ad741b0df3ac tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1958412946", "imageRef": "c32522f7-22a8-45d4-a51e-f17637def2e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "35aecb0c-8d69-4fb0-8c17-38cb8c49008a"}], "security_groups": [{"name": "tempest-securitygroup--646960198"}], "key_name": "tempest-keypair-696726489", "user_data": "}} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:56:35.641800 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:35.735431 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.network.neutron [None req-80d79969-49fc-4470-a79e-ad741b0df3ac tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] validate_networks() for [('35aecb0c-8d69-4fb0-8c17-38cb8c49008a', None, None, None, None, None)] {{(pid=127869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:56:35.758059 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-25f11eec-ebe9-4967-9315-afff6bab71c9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "DELETE /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7/os-volume_attachments/b50fd527-c6d8-4e0d-92bd-857ebfcad8ea" status: 202 len: 0 microversion: 2.20 time: 0.307725 Aug 24 03:56:35.759489 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 287/568] 10.222.0.82 () {60 vars in 1457 bytes} [Wed Aug 24 03:56:35 2022] DELETE /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7/os-volume_attachments/b50fd527-c6d8-4e0d-92bd-857ebfcad8ea => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:56:35.769435 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-368c704c-7230-4f7e-badb-556b27c9a698 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:35.771784 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-368c704c-7230-4f7e-badb-556b27c9a698 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:35.778711 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-368c704c-7230-4f7e-badb-556b27c9a698 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:35.779249 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-368c704c-7230-4f7e-badb-556b27c9a698 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:35.779682 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-368c704c-7230-4f7e-badb-556b27c9a698 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:35.780376 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-368c704c-7230-4f7e-badb-556b27c9a698 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:35.780835 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-368c704c-7230-4f7e-badb-556b27c9a698 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:35.781242 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-368c704c-7230-4f7e-badb-556b27c9a698 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:35.812201 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-368c704c-7230-4f7e-badb-556b27c9a698 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047276 Aug 24 03:56:35.812772 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 288/569] 10.222.0.82 () {60 vars in 1343 bytes} [Wed Aug 24 03:56:35 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:56:36.122820 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-80d79969-49fc-4470-a79e-ad741b0df3ac tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Flavor limits 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:56:36.133179 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-80d79969-49fc-4470-a79e-ad741b0df3ac tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Image limits 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:56:36.133179 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-80d79969-49fc-4470-a79e-ad741b0df3ac tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Flavor pref 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:56:36.133179 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-80d79969-49fc-4470-a79e-ad741b0df3ac tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Image pref 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:56:36.133179 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-80d79969-49fc-4470-a79e-ad741b0df3ac tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:56:36.134344 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-80d79969-49fc-4470-a79e-ad741b0df3ac tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:36.135160 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-80d79969-49fc-4470-a79e-ad741b0df3ac tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:36.135608 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-80d79969-49fc-4470-a79e-ad741b0df3ac tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:36.136342 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-80d79969-49fc-4470-a79e-ad741b0df3ac tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:36.136793 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-80d79969-49fc-4470-a79e-ad741b0df3ac tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:36.137217 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-80d79969-49fc-4470-a79e-ad741b0df3ac tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:36.154724 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.quota [None req-80d79969-49fc-4470-a79e-ad741b0df3ac tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Getting quotas for project 46ef5b02d8da4d2eac26b6ccfb35e1a4. Resources: {'instances', 'cores', 'ram'} {{(pid=127869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:56:36.158795 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.quota [None req-80d79969-49fc-4470-a79e-ad741b0df3ac tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Getting quotas for user e5582d10ebef459084fe287c18568f98 and project 46ef5b02d8da4d2eac26b6ccfb35e1a4. Resources: {'instances', 'cores', 'ram'} {{(pid=127869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:56:36.170674 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-80d79969-49fc-4470-a79e-ad741b0df3ac tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Going to run 1 instances... {{(pid=127869) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:56:36.173066 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-80d79969-49fc-4470-a79e-ad741b0df3ac tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 0109332f-80ab-4d03-ba4d-1a24fc88fcf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c32522f7-22a8-45d4-a51e-f17637def2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:56:36.332337 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-80d79969-49fc-4470-a79e-ad741b0df3ac tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.704197 Aug 24 03:56:36.332912 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 282/570] 10.222.0.82 () {60 vars in 1147 bytes} [Wed Aug 24 03:56:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 03:56:36.344923 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ecc59c18-0792-42d5-b0b1-0bfb326a56b7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:36.345538 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ecc59c18-0792-42d5-b0b1-0bfb326a56b7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 0109332f-80ab-4d03-ba4d-1a24fc88fcf1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:36.407563 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-ecc59c18-0792-42d5-b0b1-0bfb326a56b7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:36.414203 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ecc59c18-0792-42d5-b0b1-0bfb326a56b7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1" status: 200 len: 1241 microversion: 2.1 time: 0.073083 Aug 24 03:56:36.415011 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 289/571] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:36 2022] GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1 => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:36.634526 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-9c497ad4-89c2-42a3-be6f-dd6dcd6f62da tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:36.635242 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-9c497ad4-89c2-42a3-be6f-dd6dcd6f62da tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:36.641319 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9c497ad4-89c2-42a3-be6f-dd6dcd6f62da tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:36.641838 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9c497ad4-89c2-42a3-be6f-dd6dcd6f62da tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:36.642275 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9c497ad4-89c2-42a3-be6f-dd6dcd6f62da tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:36.643003 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9c497ad4-89c2-42a3-be6f-dd6dcd6f62da tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:36.643457 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9c497ad4-89c2-42a3-be6f-dd6dcd6f62da tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:36.643879 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9c497ad4-89c2-42a3-be6f-dd6dcd6f62da tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:36.781029 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-9c497ad4-89c2-42a3-be6f-dd6dcd6f62da tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:36.789771 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-9c497ad4-89c2-42a3-be6f-dd6dcd6f62da tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1733 microversion: 2.1 time: 0.160143 Aug 24 03:56:36.790866 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 283/572] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:36 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:36.829476 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2d8ecbe3-c62f-4f89-8574-5961961deade tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:36.831663 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2d8ecbe3-c62f-4f89-8574-5961961deade tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:36.839289 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2d8ecbe3-c62f-4f89-8574-5961961deade tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:36.839772 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2d8ecbe3-c62f-4f89-8574-5961961deade tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:36.840220 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2d8ecbe3-c62f-4f89-8574-5961961deade tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:36.840914 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2d8ecbe3-c62f-4f89-8574-5961961deade tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:36.841429 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2d8ecbe3-c62f-4f89-8574-5961961deade tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:36.841858 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2d8ecbe3-c62f-4f89-8574-5961961deade tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:36.873441 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2d8ecbe3-c62f-4f89-8574-5961961deade tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047763 Aug 24 03:56:36.874020 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 290/573] 10.222.0.82 () {60 vars in 1343 bytes} [Wed Aug 24 03:56:36 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:56:37.434993 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-4db26b8a-2245-4e3c-85b3-4d8bb89d90dd tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:37.435795 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-4db26b8a-2245-4e3c-85b3-4d8bb89d90dd tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 0109332f-80ab-4d03-ba4d-1a24fc88fcf1] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:37.443176 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4db26b8a-2245-4e3c-85b3-4d8bb89d90dd tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:37.443650 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4db26b8a-2245-4e3c-85b3-4d8bb89d90dd tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:37.444073 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4db26b8a-2245-4e3c-85b3-4d8bb89d90dd tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:37.444749 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4db26b8a-2245-4e3c-85b3-4d8bb89d90dd tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:37.445382 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4db26b8a-2245-4e3c-85b3-4d8bb89d90dd tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:37.445858 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4db26b8a-2245-4e3c-85b3-4d8bb89d90dd tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:37.507757 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-4db26b8a-2245-4e3c-85b3-4d8bb89d90dd tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:37.516127 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-4db26b8a-2245-4e3c-85b3-4d8bb89d90dd tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1" status: 200 len: 1245 microversion: 2.1 time: 0.084967 Aug 24 03:56:37.516830 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 284/574] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:37 2022] GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:37.811349 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bdafbe98-5555-47cb-9166-be859af5ba90 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:37.811964 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bdafbe98-5555-47cb-9166-be859af5ba90 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:37.818739 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bdafbe98-5555-47cb-9166-be859af5ba90 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:37.819227 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bdafbe98-5555-47cb-9166-be859af5ba90 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:37.819663 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bdafbe98-5555-47cb-9166-be859af5ba90 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:37.820516 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bdafbe98-5555-47cb-9166-be859af5ba90 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:37.821341 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bdafbe98-5555-47cb-9166-be859af5ba90 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:37.821767 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bdafbe98-5555-47cb-9166-be859af5ba90 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:37.886934 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-3e11d684-bc27-4818-8429-82fad2b79c68 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:37.889365 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-3e11d684-bc27-4818-8429-82fad2b79c68 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:37.895783 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3e11d684-bc27-4818-8429-82fad2b79c68 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:37.896256 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3e11d684-bc27-4818-8429-82fad2b79c68 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:37.896682 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3e11d684-bc27-4818-8429-82fad2b79c68 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:37.897366 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3e11d684-bc27-4818-8429-82fad2b79c68 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:37.897818 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3e11d684-bc27-4818-8429-82fad2b79c68 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:37.898233 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3e11d684-bc27-4818-8429-82fad2b79c68 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:37.928961 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-3e11d684-bc27-4818-8429-82fad2b79c68 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047163 Aug 24 03:56:37.933525 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 285/575] 10.222.0.82 () {60 vars in 1343 bytes} [Wed Aug 24 03:56:37 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:56:37.969566 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-bdafbe98-5555-47cb-9166-be859af5ba90 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:37.978834 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bdafbe98-5555-47cb-9166-be859af5ba90 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1733 microversion: 2.1 time: 0.171385 Aug 24 03:56:37.982882 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 291/576] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:37 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1733 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:56:37.995657 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-a27ce5c4-351d-4f10-9ca1-92d6e66ff930 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:37.996142 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-a27ce5c4-351d-4f10-9ca1-92d6e66ff930 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:38.002251 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a27ce5c4-351d-4f10-9ca1-92d6e66ff930 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:38.002762 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a27ce5c4-351d-4f10-9ca1-92d6e66ff930 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:38.003188 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a27ce5c4-351d-4f10-9ca1-92d6e66ff930 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:38.004053 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a27ce5c4-351d-4f10-9ca1-92d6e66ff930 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:38.004497 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a27ce5c4-351d-4f10-9ca1-92d6e66ff930 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:38.004911 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a27ce5c4-351d-4f10-9ca1-92d6e66ff930 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:38.030572 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-a27ce5c4-351d-4f10-9ca1-92d6e66ff930 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Going to try to terminate instance {{(pid=127869) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:56:38.347174 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-a27ce5c4-351d-4f10-9ca1-92d6e66ff930 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "DELETE /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 204 len: 0 microversion: 2.20 time: 0.355525 Aug 24 03:56:38.347945 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 286/577] 10.222.0.82 () {60 vars in 1280 bytes} [Wed Aug 24 03:56:37 2022] DELETE /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 03:56:38.356915 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7fee8302-9a4a-40d3-9412-0d80baac1c54 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:38.357693 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7fee8302-9a4a-40d3-9412-0d80baac1c54 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:38.360839 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:38.364314 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fee8302-9a4a-40d3-9412-0d80baac1c54 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:38.364802 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fee8302-9a4a-40d3-9412-0d80baac1c54 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:38.365299 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fee8302-9a4a-40d3-9412-0d80baac1c54 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:38.365999 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fee8302-9a4a-40d3-9412-0d80baac1c54 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:38.366454 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fee8302-9a4a-40d3-9412-0d80baac1c54 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:38.366908 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7fee8302-9a4a-40d3-9412-0d80baac1c54 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:38.498705 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-7fee8302-9a4a-40d3-9412-0d80baac1c54 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:38.506673 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-7fee8302-9a4a-40d3-9412-0d80baac1c54 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:38.508693 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-7fee8302-9a4a-40d3-9412-0d80baac1c54 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:38.510089 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7fee8302-9a4a-40d3-9412-0d80baac1c54 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1724 microversion: 2.20 time: 0.158028 Aug 24 03:56:38.510672 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 292/578] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:38 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:38.538770 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-9f418790-f833-4533-b4e3-b1a45ecaf4f9 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:38.539529 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-9f418790-f833-4533-b4e3-b1a45ecaf4f9 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 0109332f-80ab-4d03-ba4d-1a24fc88fcf1] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:38.545692 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9f418790-f833-4533-b4e3-b1a45ecaf4f9 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:38.546170 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9f418790-f833-4533-b4e3-b1a45ecaf4f9 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:38.546633 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9f418790-f833-4533-b4e3-b1a45ecaf4f9 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:38.547326 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9f418790-f833-4533-b4e3-b1a45ecaf4f9 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:38.547780 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9f418790-f833-4533-b4e3-b1a45ecaf4f9 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:38.548229 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9f418790-f833-4533-b4e3-b1a45ecaf4f9 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:38.612443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-9f418790-f833-4533-b4e3-b1a45ecaf4f9 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:38.620370 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-9f418790-f833-4533-b4e3-b1a45ecaf4f9 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1" status: 200 len: 1301 microversion: 2.1 time: 0.085839 Aug 24 03:56:38.620937 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 287/579] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:38 2022] GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1 => generated 1301 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:39.000271 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3e2c9549-11a7-4301-9a30-f02cb9ff5450 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:39.000918 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3e2c9549-11a7-4301-9a30-f02cb9ff5450 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:39.007655 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3e2c9549-11a7-4301-9a30-f02cb9ff5450 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:39.008984 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3e2c9549-11a7-4301-9a30-f02cb9ff5450 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:39.009431 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3e2c9549-11a7-4301-9a30-f02cb9ff5450 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:39.010130 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3e2c9549-11a7-4301-9a30-f02cb9ff5450 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:39.010609 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3e2c9549-11a7-4301-9a30-f02cb9ff5450 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:39.011037 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3e2c9549-11a7-4301-9a30-f02cb9ff5450 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:39.029324 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:39.144513 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-3e2c9549-11a7-4301-9a30-f02cb9ff5450 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:39.152816 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3e2c9549-11a7-4301-9a30-f02cb9ff5450 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1733 microversion: 2.1 time: 0.156904 Aug 24 03:56:39.153390 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 293/580] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:38 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:39.533263 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-40b9d54d-8e42-4d21-8340-c555c1af47ca tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:39.533886 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-40b9d54d-8e42-4d21-8340-c555c1af47ca tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:39.541049 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-40b9d54d-8e42-4d21-8340-c555c1af47ca tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:39.541512 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-40b9d54d-8e42-4d21-8340-c555c1af47ca tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:39.541934 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-40b9d54d-8e42-4d21-8340-c555c1af47ca tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:39.542638 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-40b9d54d-8e42-4d21-8340-c555c1af47ca tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:39.543080 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-40b9d54d-8e42-4d21-8340-c555c1af47ca tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:39.543493 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-40b9d54d-8e42-4d21-8340-c555c1af47ca tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:39.650998 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9e99b53a-5032-4f58-a60d-ff3ea07d9513 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:39.651706 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9e99b53a-5032-4f58-a60d-ff3ea07d9513 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 0109332f-80ab-4d03-ba4d-1a24fc88fcf1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:39.663176 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e99b53a-5032-4f58-a60d-ff3ea07d9513 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:39.663811 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e99b53a-5032-4f58-a60d-ff3ea07d9513 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:39.664704 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e99b53a-5032-4f58-a60d-ff3ea07d9513 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:39.665625 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e99b53a-5032-4f58-a60d-ff3ea07d9513 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:39.666204 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e99b53a-5032-4f58-a60d-ff3ea07d9513 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:39.666779 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9e99b53a-5032-4f58-a60d-ff3ea07d9513 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:39.680394 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-40b9d54d-8e42-4d21-8340-c555c1af47ca tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:39.688704 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-40b9d54d-8e42-4d21-8340-c555c1af47ca tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:39.690199 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-40b9d54d-8e42-4d21-8340-c555c1af47ca tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:39.691954 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-40b9d54d-8e42-4d21-8340-c555c1af47ca tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1724 microversion: 2.20 time: 0.162382 Aug 24 03:56:39.692526 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 288/581] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:39 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:39.729711 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-9e99b53a-5032-4f58-a60d-ff3ea07d9513 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:39.737437 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9e99b53a-5032-4f58-a60d-ff3ea07d9513 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1" status: 200 len: 1301 microversion: 2.1 time: 0.099837 Aug 24 03:56:39.738000 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 294/582] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:39 2022] GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1 => generated 1301 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:56:40.174089 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-355802db-2fe9-43bc-9f23-fba782a8905c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:40.174778 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-355802db-2fe9-43bc-9f23-fba782a8905c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:40.181299 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-355802db-2fe9-43bc-9f23-fba782a8905c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:40.181774 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-355802db-2fe9-43bc-9f23-fba782a8905c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:40.182204 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-355802db-2fe9-43bc-9f23-fba782a8905c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:40.182981 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-355802db-2fe9-43bc-9f23-fba782a8905c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:40.183431 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-355802db-2fe9-43bc-9f23-fba782a8905c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:40.183851 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-355802db-2fe9-43bc-9f23-fba782a8905c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:40.315855 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-355802db-2fe9-43bc-9f23-fba782a8905c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:40.324300 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-355802db-2fe9-43bc-9f23-fba782a8905c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1733 microversion: 2.1 time: 0.154065 Aug 24 03:56:40.324860 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 289/583] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:40 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:40.717227 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-372871b6-c700-4ca9-9375-8c2c802d87ea tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:40.717829 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-372871b6-c700-4ca9-9375-8c2c802d87ea tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:40.730018 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-372871b6-c700-4ca9-9375-8c2c802d87ea tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:40.730018 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-372871b6-c700-4ca9-9375-8c2c802d87ea tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:40.730018 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-372871b6-c700-4ca9-9375-8c2c802d87ea tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:40.730018 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-372871b6-c700-4ca9-9375-8c2c802d87ea tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:40.730402 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-372871b6-c700-4ca9-9375-8c2c802d87ea tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:40.730402 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-372871b6-c700-4ca9-9375-8c2c802d87ea tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:40.760518 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-43430b85-3aea-4e8e-8824-11038b2748dc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:40.762067 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-43430b85-3aea-4e8e-8824-11038b2748dc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 0109332f-80ab-4d03-ba4d-1a24fc88fcf1] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:40.770324 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-43430b85-3aea-4e8e-8824-11038b2748dc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:40.771187 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-43430b85-3aea-4e8e-8824-11038b2748dc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:40.772219 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-43430b85-3aea-4e8e-8824-11038b2748dc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:40.773112 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-43430b85-3aea-4e8e-8824-11038b2748dc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:40.774435 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-43430b85-3aea-4e8e-8824-11038b2748dc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:40.775461 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-43430b85-3aea-4e8e-8824-11038b2748dc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:40.868438 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-43430b85-3aea-4e8e-8824-11038b2748dc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:40.876504 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-43430b85-3aea-4e8e-8824-11038b2748dc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1" status: 200 len: 1299 microversion: 2.1 time: 0.121000 Aug 24 03:56:40.879220 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 290/584] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:40 2022] GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1 => generated 1299 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:56:40.984606 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-372871b6-c700-4ca9-9375-8c2c802d87ea tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:40.993994 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-372871b6-c700-4ca9-9375-8c2c802d87ea tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:40.995720 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-372871b6-c700-4ca9-9375-8c2c802d87ea tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:40.997016 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-372871b6-c700-4ca9-9375-8c2c802d87ea tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1724 microversion: 2.20 time: 0.284018 Aug 24 03:56:40.997682 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 295/585] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:40 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1724 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:41.364828 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-d4d2b5a6-bcb4-4240-9736-e278a606a21c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:41.365448 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-d4d2b5a6-bcb4-4240-9736-e278a606a21c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:41.372971 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d4d2b5a6-bcb4-4240-9736-e278a606a21c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:41.373692 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d4d2b5a6-bcb4-4240-9736-e278a606a21c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:41.374311 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d4d2b5a6-bcb4-4240-9736-e278a606a21c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:41.375505 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d4d2b5a6-bcb4-4240-9736-e278a606a21c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:41.376124 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d4d2b5a6-bcb4-4240-9736-e278a606a21c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:41.376895 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d4d2b5a6-bcb4-4240-9736-e278a606a21c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:41.396836 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:41.548280 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-80a4be71-7d35-472f-9fcc-9a605b92bae9 req-9c708495-2a5d-4f40-a935-f787385c6cd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8b22210-7e08-4f01-bf00-d84b0e5e34d7", "name": "network-vif-deleted", "tag": "a6ef21fe-e9ce-414a-a115-1f2f2babf6fc"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:56:41.567622 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-80a4be71-7d35-472f-9fcc-9a605b92bae9 req-9c708495-2a5d-4f40-a935-f787385c6cd7 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:41.568365 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-80a4be71-7d35-472f-9fcc-9a605b92bae9 req-9c708495-2a5d-4f40-a935-f787385c6cd7 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:41.568974 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-80a4be71-7d35-472f-9fcc-9a605b92bae9 req-9c708495-2a5d-4f40-a935-f787385c6cd7 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:41.583148 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-80a4be71-7d35-472f-9fcc-9a605b92bae9 req-9c708495-2a5d-4f40-a935-f787385c6cd7 service nova] Creating event network-vif-deleted:a6ef21fe-e9ce-414a-a115-1f2f2babf6fc for instance b8b22210-7e08-4f01-bf00-d84b0e5e34d7 on hv-cinder-85426 Aug 24 03:56:41.597817 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-80a4be71-7d35-472f-9fcc-9a605b92bae9 req-9c708495-2a5d-4f40-a935-f787385c6cd7 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052457 Aug 24 03:56:41.598792 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 296/586] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:56:41.628873 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-d4d2b5a6-bcb4-4240-9736-e278a606a21c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:41.643446 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-d4d2b5a6-bcb4-4240-9736-e278a606a21c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1733 microversion: 2.1 time: 0.282331 Aug 24 03:56:41.644554 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 291/587] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:41 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1733 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:41.900793 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4b1fd0ab-b9a5-4d31-9ffb-d1286af5237e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:41.902123 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4b1fd0ab-b9a5-4d31-9ffb-d1286af5237e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 0109332f-80ab-4d03-ba4d-1a24fc88fcf1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:41.910305 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4b1fd0ab-b9a5-4d31-9ffb-d1286af5237e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:41.911071 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4b1fd0ab-b9a5-4d31-9ffb-d1286af5237e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:41.911693 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4b1fd0ab-b9a5-4d31-9ffb-d1286af5237e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:41.912605 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4b1fd0ab-b9a5-4d31-9ffb-d1286af5237e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:41.913237 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4b1fd0ab-b9a5-4d31-9ffb-d1286af5237e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:41.913821 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4b1fd0ab-b9a5-4d31-9ffb-d1286af5237e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:42.021214 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-1198e6ea-3a25-4472-85fb-0404318a2144 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:42.023032 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-1198e6ea-3a25-4472-85fb-0404318a2144 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:42.030354 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1198e6ea-3a25-4472-85fb-0404318a2144 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:42.030943 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1198e6ea-3a25-4472-85fb-0404318a2144 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:42.031463 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1198e6ea-3a25-4472-85fb-0404318a2144 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:42.032230 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1198e6ea-3a25-4472-85fb-0404318a2144 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:42.032892 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1198e6ea-3a25-4472-85fb-0404318a2144 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:42.033390 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1198e6ea-3a25-4472-85fb-0404318a2144 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:42.072486 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1198e6ea-3a25-4472-85fb-0404318a2144 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:42.073517 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1198e6ea-3a25-4472-85fb-0404318a2144 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:42.074361 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1198e6ea-3a25-4472-85fb-0404318a2144 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:42.075272 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.objects.instance [None req-1198e6ea-3a25-4472-85fb-0404318a2144 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lazy-loading 'fault' on Instance uuid b8b22210-7e08-4f01-bf00-d84b0e5e34d7 {{(pid=127869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:56:42.128460 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-1198e6ea-3a25-4472-85fb-0404318a2144 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:42.140190 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-1198e6ea-3a25-4472-85fb-0404318a2144 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:42.145100 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-1198e6ea-3a25-4472-85fb-0404318a2144 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:42.145100 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-1198e6ea-3a25-4472-85fb-0404318a2144 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 200 len: 1372 microversion: 2.20 time: 0.125845 Aug 24 03:56:42.145100 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 292/588] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:42 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 1372 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:56:42.147527 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-4b1fd0ab-b9a5-4d31-9ffb-d1286af5237e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:42.158027 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4b1fd0ab-b9a5-4d31-9ffb-d1286af5237e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1" status: 200 len: 1366 microversion: 2.1 time: 0.263395 Aug 24 03:56:42.159342 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 297/589] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:41 2022] GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1 => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:42.276973 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-0ef26b79-6cd3-48b8-a201-6ddd3cddd25c req-d1425b4c-0322-41f9-8634-47311c905e4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0109332f-80ab-4d03-ba4d-1a24fc88fcf1", "tag": "6fb7eefd-3c2e-44a9-aa1e-a1eba153d019"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:56:42.288328 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-0ef26b79-6cd3-48b8-a201-6ddd3cddd25c req-d1425b4c-0322-41f9-8634-47311c905e4d service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:42.288793 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-0ef26b79-6cd3-48b8-a201-6ddd3cddd25c req-d1425b4c-0322-41f9-8634-47311c905e4d service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:42.289370 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-0ef26b79-6cd3-48b8-a201-6ddd3cddd25c req-d1425b4c-0322-41f9-8634-47311c905e4d service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:42.309628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-0ef26b79-6cd3-48b8-a201-6ddd3cddd25c req-d1425b4c-0322-41f9-8634-47311c905e4d service nova] Creating event network-changed:6fb7eefd-3c2e-44a9-aa1e-a1eba153d019 for instance 0109332f-80ab-4d03-ba4d-1a24fc88fcf1 on hv-cinder-85426 Aug 24 03:56:42.315467 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-0ef26b79-6cd3-48b8-a201-6ddd3cddd25c req-d1425b4c-0322-41f9-8634-47311c905e4d service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046171 Aug 24 03:56:42.316953 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 293/590] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:56:42.668076 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a4f8c74d-2ed2-45b0-8e8a-cceb95c8413c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:42.668688 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a4f8c74d-2ed2-45b0-8e8a-cceb95c8413c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:42.674937 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a4f8c74d-2ed2-45b0-8e8a-cceb95c8413c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:42.675403 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a4f8c74d-2ed2-45b0-8e8a-cceb95c8413c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:42.675837 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a4f8c74d-2ed2-45b0-8e8a-cceb95c8413c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:42.676647 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a4f8c74d-2ed2-45b0-8e8a-cceb95c8413c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:42.677094 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a4f8c74d-2ed2-45b0-8e8a-cceb95c8413c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:42.677983 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a4f8c74d-2ed2-45b0-8e8a-cceb95c8413c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:42.890687 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-a4f8c74d-2ed2-45b0-8e8a-cceb95c8413c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:42.900294 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a4f8c74d-2ed2-45b0-8e8a-cceb95c8413c tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1733 microversion: 2.1 time: 0.235983 Aug 24 03:56:42.901242 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 298/591] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:42 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1733 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:43.167674 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-fda7ede2-a561-44f8-b7a3-ffc95dbb3450 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:43.168488 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-fda7ede2-a561-44f8-b7a3-ffc95dbb3450 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:43.174752 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-fda7ede2-a561-44f8-b7a3-ffc95dbb3450 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:43.175237 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-fda7ede2-a561-44f8-b7a3-ffc95dbb3450 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:43.175684 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-fda7ede2-a561-44f8-b7a3-ffc95dbb3450 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:43.176356 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-fda7ede2-a561-44f8-b7a3-ffc95dbb3450 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:43.176810 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-fda7ede2-a561-44f8-b7a3-ffc95dbb3450 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:43.177232 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-fda7ede2-a561-44f8-b7a3-ffc95dbb3450 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:43.178211 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cce4a55b-85d1-4b9c-9e00-a3386408e231 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:43.178842 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cce4a55b-85d1-4b9c-9e00-a3386408e231 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 0109332f-80ab-4d03-ba4d-1a24fc88fcf1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:43.186016 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cce4a55b-85d1-4b9c-9e00-a3386408e231 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:43.186753 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cce4a55b-85d1-4b9c-9e00-a3386408e231 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:43.187188 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cce4a55b-85d1-4b9c-9e00-a3386408e231 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:43.187881 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cce4a55b-85d1-4b9c-9e00-a3386408e231 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:43.188323 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cce4a55b-85d1-4b9c-9e00-a3386408e231 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:43.188935 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cce4a55b-85d1-4b9c-9e00-a3386408e231 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:43.192232 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.wsgi [None req-fda7ede2-a561-44f8-b7a3-ffc95dbb3450 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] HTTP exception thrown: Instance b8b22210-7e08-4f01-bf00-d84b0e5e34d7 could not be found. Aug 24 03:56:43.193882 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-fda7ede2-a561-44f8-b7a3-ffc95dbb3450 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Request method failure captured: Aug 24 03:56:43.193882 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: request: GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 HTTP/1.1 Aug 24 03:56:43.193882 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept: application/json Aug 24 03:56:43.193882 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept-Encoding: identity Aug 24 03:56:43.193882 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Connection: close Aug 24 03:56:43.193882 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Length: 0 Aug 24 03:56:43.193882 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Type: application/json Aug 24 03:56:43.193882 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Host: 10.222.0.82 Aug 24 03:56:43.193882 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Openstack-System-Scope: None Aug 24 03:56:43.193882 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: User-Agent: python-urllib3/1.26.11 Aug 24 03:56:43.193882 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Auth-Token: gAAAAABjBaBwKioTEHcsapPMXzumUz8JfXs4PoUV_t0Zy5ObURRuX8BBtHkCsfhi7ljFttNNOP0mL5Fr25AjwSEs4D3IhDHzTWzDVQV3EzbMg-SOpApwzrV3x5b_OuWvZrG3wjFzPeJFOOIdQ1rLChA9ba-MjD4IVxtsZgT4cR-WfO1UOc5Jg88 Aug 24 03:56:43.193882 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Id: None Aug 24 03:56:43.193882 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Name: None Aug 24 03:56:43.193882 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Identity-Status: Confirmed Aug 24 03:56:43.193882 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Is-Admin-Project: True Aug 24 03:56:43.193882 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 03:56:43.193882 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Id: default Aug 24 03:56:43.193882 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Name: Default Aug 24 03:56:43.193882 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Id: feac5069d37149628113087d9d93912b Aug 24 03:56:43.193882 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1812885697 Aug 24 03:56:43.193882 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Role: member,reader Aug 24 03:56:43.193882 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Roles: member,reader Aug 24 03:56:43.195756 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/feac5069d37149628113087d9d93912b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/feac5069d37149628113087d9d93912b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/feac5069d37149628113087d9d93912b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_feac5069d37149628113087d9d93912b", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:56:43.195756 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1812885697 Aug 24 03:56:43.195756 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Id: feac5069d37149628113087d9d93912b Aug 24 03:56:43.195756 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1812885697 Aug 24 03:56:43.195756 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User: tempest-AttachVolumeShelveTestJSON-1812885697-project Aug 24 03:56:43.195756 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Id: default Aug 24 03:56:43.195756 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Name: Default Aug 24 03:56:43.195756 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Id: 87a0f4d8b8c341ed85618e70adb2def4 Aug 24 03:56:43.195756 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1812885697-project Aug 24 03:56:43.195756 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: method: > Aug 24 03:56:43.195756 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: exception: Instance b8b22210-7e08-4f01-bf00-d84b0e5e34d7 could not be found. Aug 24 03:56:43.195756 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: action_args: {'id': 'b8b22210-7e08-4f01-bf00-d84b0e5e34d7'} Aug 24 03:56:43.196699 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:56:43.196699 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:56:43.196699 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:56:43.196699 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:56:43.196699 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:56:43.196699 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:56:43.196699 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:56:43.196699 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:56:43.196699 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:56:43.196699 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:56:43.196699 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8b22210-7e08-4f01-bf00-d84b0e5e34d7 could not be found. Aug 24 03:56:43.196699 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:56:43.196699 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:56:43.196699 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:56:43.196699 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:56:43.196699 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:56:43.196699 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:56:43.196699 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:56:43.196699 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:56:43.196699 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:56:43.198140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:56:43.198140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:56:43.198140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:56:43.198140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:56:43.198140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:56:43.198140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:56:43.198140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:56:43.198140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8b22210-7e08-4f01-bf00-d84b0e5e34d7 could not be found. Aug 24 03:56:43.198140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:56:43.198140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:56:43.198140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:56:43.198140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:56:43.198140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:56:43.198140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:56:43.198140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:56:43.198140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:56:43.198140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8b22210-7e08-4f01-bf00-d84b0e5e34d7 could not be found. Aug 24 03:56:43.198140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:56:43.199483 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-fda7ede2-a561-44f8-b7a3-ffc95dbb3450 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Returning 404 to user: Instance b8b22210-7e08-4f01-bf00-d84b0e5e34d7 could not be found. {{(pid=127869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:56:43.199483 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-fda7ede2-a561-44f8-b7a3-ffc95dbb3450 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 404 len: 111 microversion: 2.20 time: 0.033036 Aug 24 03:56:43.199483 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 294/592] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:43 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:56:43.208075 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-0b480822-fe43-4561-80f5-8bb4c9bfc67d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '.version_select at 0x7f1554358b80>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:43.301632 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-0b480822-fe43-4561-80f5-8bb4c9bfc67d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1524783453" status: 204 len: 0 microversion: 2.20 time: 0.097233 Aug 24 03:56:43.302303 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 295/593] 10.222.0.82 () {60 vars in 1262 bytes} [Wed Aug 24 03:56:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1524783453 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 03:56:43.403428 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-cce4a55b-85d1-4b9c-9e00-a3386408e231 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:43.412450 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cce4a55b-85d1-4b9c-9e00-a3386408e231 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1" status: 200 len: 1366 microversion: 2.1 time: 0.237921 Aug 24 03:56:43.413033 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 299/594] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:43 2022] GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:56:43.921204 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-9e35f5e6-0e57-407b-8172-63f4d3ea35fc tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:43.921801 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-9e35f5e6-0e57-407b-8172-63f4d3ea35fc tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:43.928499 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9e35f5e6-0e57-407b-8172-63f4d3ea35fc tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:43.928917 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9e35f5e6-0e57-407b-8172-63f4d3ea35fc tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:43.929911 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9e35f5e6-0e57-407b-8172-63f4d3ea35fc tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:43.930627 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9e35f5e6-0e57-407b-8172-63f4d3ea35fc tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:43.931063 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9e35f5e6-0e57-407b-8172-63f4d3ea35fc tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:43.931474 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9e35f5e6-0e57-407b-8172-63f4d3ea35fc tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:44.067081 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ebc5e567-a46b-42bc-97ac-9a0c77fa4436 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Action: 'create', calling method: .version_select at 0x7f1554097ca0>, body: {"keypair": {"name": "tempest-keypair-418937145", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ8MnDjsNEjjqu/sRH3Lgr4fhvpN7g8ybKhTzGs2m58fS4GUS2GZMefN4oKSlHOWMP4ouKj16rwykY44Dqt/7wslsLXVEMX3Sq57Pgn418+T/UKxzyRnnqnbZzLLF/DFg=="}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:56:44.083474 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.quota [None req-ebc5e567-a46b-42bc-97ac-9a0c77fa4436 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Getting quotas for project feac5069d37149628113087d9d93912b. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:56:44.085372 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-9e35f5e6-0e57-407b-8172-63f4d3ea35fc tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:44.087630 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.quota [None req-ebc5e567-a46b-42bc-97ac-9a0c77fa4436 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Getting quotas for user 87a0f4d8b8c341ed85618e70adb2def4 and project feac5069d37149628113087d9d93912b. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:56:44.093677 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-9e35f5e6-0e57-407b-8172-63f4d3ea35fc tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1733 microversion: 2.1 time: 0.176364 Aug 24 03:56:44.094414 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 296/595] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:43 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1733 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:44.176198 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ebc5e567-a46b-42bc-97ac-9a0c77fa4436 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.113060 Aug 24 03:56:44.176803 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 300/596] 10.222.0.82 () {62 vars in 1200 bytes} [Wed Aug 24 03:56:44 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 114 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 24 03:56:44.434119 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-fe5fdc5f-159d-4190-abcb-cd8cd29bdc46 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:44.435171 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-fe5fdc5f-159d-4190-abcb-cd8cd29bdc46 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 0109332f-80ab-4d03-ba4d-1a24fc88fcf1] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:44.442264 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-fe5fdc5f-159d-4190-abcb-cd8cd29bdc46 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:44.442721 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-fe5fdc5f-159d-4190-abcb-cd8cd29bdc46 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:44.443158 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-fe5fdc5f-159d-4190-abcb-cd8cd29bdc46 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:44.443851 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-fe5fdc5f-159d-4190-abcb-cd8cd29bdc46 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:44.444301 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-fe5fdc5f-159d-4190-abcb-cd8cd29bdc46 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:44.444727 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-fe5fdc5f-159d-4190-abcb-cd8cd29bdc46 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:44.600082 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-fe5fdc5f-159d-4190-abcb-cd8cd29bdc46 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:44.608849 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-fe5fdc5f-159d-4190-abcb-cd8cd29bdc46 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1" status: 200 len: 1366 microversion: 2.1 time: 0.179152 Aug 24 03:56:44.609607 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 297/597] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:44 2022] GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:45.117122 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-426ecca8-07ef-4a6d-8dde-1b9f5cd4dd27 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:45.121051 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-426ecca8-07ef-4a6d-8dde-1b9f5cd4dd27 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:45.124157 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-426ecca8-07ef-4a6d-8dde-1b9f5cd4dd27 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:45.124635 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-426ecca8-07ef-4a6d-8dde-1b9f5cd4dd27 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:45.125159 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-426ecca8-07ef-4a6d-8dde-1b9f5cd4dd27 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:45.125844 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-426ecca8-07ef-4a6d-8dde-1b9f5cd4dd27 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:45.126356 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-426ecca8-07ef-4a6d-8dde-1b9f5cd4dd27 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:45.127010 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-426ecca8-07ef-4a6d-8dde-1b9f5cd4dd27 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:45.269445 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-426ecca8-07ef-4a6d-8dde-1b9f5cd4dd27 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:45.278543 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-426ecca8-07ef-4a6d-8dde-1b9f5cd4dd27 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1733 microversion: 2.1 time: 0.165904 Aug 24 03:56:45.279119 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 301/598] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:45 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1733 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:45.630442 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-ace947ab-0b49-455e-9c8e-e80ce48393bf tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:45.630993 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-ace947ab-0b49-455e-9c8e-e80ce48393bf tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 0109332f-80ab-4d03-ba4d-1a24fc88fcf1] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:45.638636 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ace947ab-0b49-455e-9c8e-e80ce48393bf tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:45.638949 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ace947ab-0b49-455e-9c8e-e80ce48393bf tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:45.639376 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ace947ab-0b49-455e-9c8e-e80ce48393bf tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:45.640061 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ace947ab-0b49-455e-9c8e-e80ce48393bf tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:45.640502 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ace947ab-0b49-455e-9c8e-e80ce48393bf tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:45.640913 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ace947ab-0b49-455e-9c8e-e80ce48393bf tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:45.844138 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-ace947ab-0b49-455e-9c8e-e80ce48393bf tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:45.852509 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-ace947ab-0b49-455e-9c8e-e80ce48393bf tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1" status: 200 len: 1366 microversion: 2.1 time: 0.225916 Aug 24 03:56:45.853129 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 298/599] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:45 2022] GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:46.301226 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4c074ce5-4cf3-4c30-aaea-a6152b387bad tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:46.301856 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4c074ce5-4cf3-4c30-aaea-a6152b387bad tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:46.309131 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4c074ce5-4cf3-4c30-aaea-a6152b387bad tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:46.309605 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4c074ce5-4cf3-4c30-aaea-a6152b387bad tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:46.310032 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4c074ce5-4cf3-4c30-aaea-a6152b387bad tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:46.310752 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4c074ce5-4cf3-4c30-aaea-a6152b387bad tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:46.311196 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4c074ce5-4cf3-4c30-aaea-a6152b387bad tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:46.311608 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4c074ce5-4cf3-4c30-aaea-a6152b387bad tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:46.471130 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-4c074ce5-4cf3-4c30-aaea-a6152b387bad tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:46.480096 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4c074ce5-4cf3-4c30-aaea-a6152b387bad tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1733 microversion: 2.1 time: 0.182670 Aug 24 03:56:46.480771 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 302/600] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:46 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1733 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:56:46.840405 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-0c862964-a72a-4d27-8685-fcfb6ebc767e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1123955722", "imageRef": "c32522f7-22a8-45d4-a51e-f17637def2e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "211e2a76-8131-441d-bb4a-b48c244f355e"}], "security_groups": [{"name": "tempest-securitygroup--439710252"}], "key_name": "tempest-keypair-418937145", "user_data": "}} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:56:46.849671 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell0:SELECT=2 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:46.850491 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell0:SELECT=10 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:46.872945 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6d04a67a-7a6a-4275-97c7-836a1fe82736 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:46.873632 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6d04a67a-7a6a-4275-97c7-836a1fe82736 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 0109332f-80ab-4d03-ba4d-1a24fc88fcf1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:46.879483 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d04a67a-7a6a-4275-97c7-836a1fe82736 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:46.883935 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d04a67a-7a6a-4275-97c7-836a1fe82736 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:46.883935 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d04a67a-7a6a-4275-97c7-836a1fe82736 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:46.883935 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d04a67a-7a6a-4275-97c7-836a1fe82736 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:46.883935 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d04a67a-7a6a-4275-97c7-836a1fe82736 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:46.884269 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6d04a67a-7a6a-4275-97c7-836a1fe82736 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:46.958697 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.network.neutron [None req-0c862964-a72a-4d27-8685-fcfb6ebc767e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] validate_networks() for [('211e2a76-8131-441d-bb4a-b48c244f355e', None, None, None, None, None)] {{(pid=127869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:56:47.015844 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-6d04a67a-7a6a-4275-97c7-836a1fe82736 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:47.026254 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6d04a67a-7a6a-4275-97c7-836a1fe82736 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1" status: 200 len: 1366 microversion: 2.1 time: 0.157018 Aug 24 03:56:47.026935 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 303/601] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:46 2022] GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:56:47.335042 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-0c862964-a72a-4d27-8685-fcfb6ebc767e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Flavor limits 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:56:47.335762 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-0c862964-a72a-4d27-8685-fcfb6ebc767e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Image limits 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:56:47.336485 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-0c862964-a72a-4d27-8685-fcfb6ebc767e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Flavor pref 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:56:47.336921 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-0c862964-a72a-4d27-8685-fcfb6ebc767e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Image pref 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:56:47.337363 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-0c862964-a72a-4d27-8685-fcfb6ebc767e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:56:47.346429 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0c862964-a72a-4d27-8685-fcfb6ebc767e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:47.346935 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0c862964-a72a-4d27-8685-fcfb6ebc767e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:47.347370 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0c862964-a72a-4d27-8685-fcfb6ebc767e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:47.348093 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0c862964-a72a-4d27-8685-fcfb6ebc767e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:47.348543 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0c862964-a72a-4d27-8685-fcfb6ebc767e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:47.348966 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0c862964-a72a-4d27-8685-fcfb6ebc767e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:47.366187 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.quota [None req-0c862964-a72a-4d27-8685-fcfb6ebc767e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Getting quotas for project feac5069d37149628113087d9d93912b. Resources: {'instances', 'cores', 'ram'} {{(pid=127869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:56:47.371049 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.quota [None req-0c862964-a72a-4d27-8685-fcfb6ebc767e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Getting quotas for user 87a0f4d8b8c341ed85618e70adb2def4 and project feac5069d37149628113087d9d93912b. Resources: {'instances', 'cores', 'ram'} {{(pid=127869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:56:47.383656 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-0c862964-a72a-4d27-8685-fcfb6ebc767e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Going to run 1 instances... {{(pid=127869) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:56:47.385979 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-0c862964-a72a-4d27-8685-fcfb6ebc767e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c32522f7-22a8-45d4-a51e-f17637def2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:56:47.501401 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f9ef4b9a-45e8-474c-8800-95ce1c39f224 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:47.501978 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f9ef4b9a-45e8-474c-8800-95ce1c39f224 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:47.508682 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f9ef4b9a-45e8-474c-8800-95ce1c39f224 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:47.509165 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f9ef4b9a-45e8-474c-8800-95ce1c39f224 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:47.509718 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f9ef4b9a-45e8-474c-8800-95ce1c39f224 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:47.510350 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f9ef4b9a-45e8-474c-8800-95ce1c39f224 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:47.510831 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f9ef4b9a-45e8-474c-8800-95ce1c39f224 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:47.511283 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f9ef4b9a-45e8-474c-8800-95ce1c39f224 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:47.549436 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-0c862964-a72a-4d27-8685-fcfb6ebc767e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.714285 Aug 24 03:56:47.550258 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 299/602] 10.222.0.82 () {62 vars in 1188 bytes} [Wed Aug 24 03:56:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 03:56:47.561807 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-4076ee47-16e0-4053-a578-a596440525bf tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:47.562410 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-4076ee47-16e0-4053-a578-a596440525bf tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:47.621118 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-4076ee47-16e0-4053-a578-a596440525bf tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:47.629593 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-4076ee47-16e0-4053-a578-a596440525bf tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:47.631367 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-4076ee47-16e0-4053-a578-a596440525bf tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:47.632697 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-4076ee47-16e0-4053-a578-a596440525bf tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1281 microversion: 2.20 time: 0.074630 Aug 24 03:56:47.633963 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 300/603] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:47 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:56:47.655157 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-f9ef4b9a-45e8-474c-8800-95ce1c39f224 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:47.664769 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f9ef4b9a-45e8-474c-8800-95ce1c39f224 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1733 microversion: 2.1 time: 0.166112 Aug 24 03:56:47.665368 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 304/604] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:47 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1733 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:56:48.052239 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-09d51c08-d668-4fde-a99f-8d88325e2b11 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:48.053476 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-09d51c08-d668-4fde-a99f-8d88325e2b11 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 0109332f-80ab-4d03-ba4d-1a24fc88fcf1] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:48.061255 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-09d51c08-d668-4fde-a99f-8d88325e2b11 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:48.062019 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-09d51c08-d668-4fde-a99f-8d88325e2b11 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:48.062455 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-09d51c08-d668-4fde-a99f-8d88325e2b11 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:48.063291 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-09d51c08-d668-4fde-a99f-8d88325e2b11 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:48.064619 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-09d51c08-d668-4fde-a99f-8d88325e2b11 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:48.065366 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-09d51c08-d668-4fde-a99f-8d88325e2b11 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:48.211489 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-09d51c08-d668-4fde-a99f-8d88325e2b11 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:48.219134 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-09d51c08-d668-4fde-a99f-8d88325e2b11 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1" status: 200 len: 1366 microversion: 2.1 time: 0.174785 Aug 24 03:56:48.219698 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 301/605] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:48 2022] GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:48.278683 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-3a93ee10-1e1d-4cd3-9f1e-dcc39dbca1a0 req-9c181558-b3ed-4f7b-8106-8ddda19d22fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0109332f-80ab-4d03-ba4d-1a24fc88fcf1", "name": "network-vif-plugged", "status": "completed", "tag": "6fb7eefd-3c2e-44a9-aa1e-a1eba153d019"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:56:48.289981 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-3a93ee10-1e1d-4cd3-9f1e-dcc39dbca1a0 req-9c181558-b3ed-4f7b-8106-8ddda19d22fe service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:48.291186 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-3a93ee10-1e1d-4cd3-9f1e-dcc39dbca1a0 req-9c181558-b3ed-4f7b-8106-8ddda19d22fe service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:48.291186 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-3a93ee10-1e1d-4cd3-9f1e-dcc39dbca1a0 req-9c181558-b3ed-4f7b-8106-8ddda19d22fe service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:48.301957 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-3a93ee10-1e1d-4cd3-9f1e-dcc39dbca1a0 req-9c181558-b3ed-4f7b-8106-8ddda19d22fe service nova] Creating event network-vif-plugged:6fb7eefd-3c2e-44a9-aa1e-a1eba153d019 for instance 0109332f-80ab-4d03-ba4d-1a24fc88fcf1 on hv-cinder-85426 Aug 24 03:56:48.307084 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-3a93ee10-1e1d-4cd3-9f1e-dcc39dbca1a0 req-9c181558-b3ed-4f7b-8106-8ddda19d22fe service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032073 Aug 24 03:56:48.307673 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 305/606] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:56:48.655602 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-2cee57b1-cca8-4445-878b-3cbb04a121da tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:48.656206 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-2cee57b1-cca8-4445-878b-3cbb04a121da tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:48.663154 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2cee57b1-cca8-4445-878b-3cbb04a121da tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:48.664715 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2cee57b1-cca8-4445-878b-3cbb04a121da tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:48.665172 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2cee57b1-cca8-4445-878b-3cbb04a121da tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:48.665896 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2cee57b1-cca8-4445-878b-3cbb04a121da tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:48.666357 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2cee57b1-cca8-4445-878b-3cbb04a121da tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:48.666809 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2cee57b1-cca8-4445-878b-3cbb04a121da tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:48.687310 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-65d53dc6-5ffe-423f-a22a-db839e47a06e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:48.688638 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-65d53dc6-5ffe-423f-a22a-db839e47a06e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:48.695375 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-65d53dc6-5ffe-423f-a22a-db839e47a06e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:48.695864 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-65d53dc6-5ffe-423f-a22a-db839e47a06e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:48.696304 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-65d53dc6-5ffe-423f-a22a-db839e47a06e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:48.697006 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-65d53dc6-5ffe-423f-a22a-db839e47a06e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:48.697460 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-65d53dc6-5ffe-423f-a22a-db839e47a06e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:48.697944 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-65d53dc6-5ffe-423f-a22a-db839e47a06e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:48.734388 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-2cee57b1-cca8-4445-878b-3cbb04a121da tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:48.743924 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-2cee57b1-cca8-4445-878b-3cbb04a121da tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:48.745560 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-2cee57b1-cca8-4445-878b-3cbb04a121da tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:48.746759 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-2cee57b1-cca8-4445-878b-3cbb04a121da tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1285 microversion: 2.20 time: 0.095629 Aug 24 03:56:48.747440 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 302/607] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:48 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:48.875761 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-65d53dc6-5ffe-423f-a22a-db839e47a06e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:48.884356 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-65d53dc6-5ffe-423f-a22a-db839e47a06e tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1713 microversion: 2.1 time: 0.201914 Aug 24 03:56:48.884929 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 306/608] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:48 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1713 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:48.994364 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-751cc75e-1fe7-4570-9b2d-0a5569f5cdd0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:48.994874 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-751cc75e-1fe7-4570-9b2d-0a5569f5cdd0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:49.000934 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-751cc75e-1fe7-4570-9b2d-0a5569f5cdd0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:49.001411 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-751cc75e-1fe7-4570-9b2d-0a5569f5cdd0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:49.001840 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-751cc75e-1fe7-4570-9b2d-0a5569f5cdd0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:49.002567 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-751cc75e-1fe7-4570-9b2d-0a5569f5cdd0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:49.003018 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-751cc75e-1fe7-4570-9b2d-0a5569f5cdd0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:49.003439 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-751cc75e-1fe7-4570-9b2d-0a5569f5cdd0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:49.129641 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.wsgi [None req-751cc75e-1fe7-4570-9b2d-0a5569f5cdd0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] HTTP exception thrown: Cannot 'detach_volume' instance 95c868c4-fc26-429b-8f03-9edf2d7e8a70 while it is in vm_state rescued Aug 24 03:56:49.131159 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-751cc75e-1fe7-4570-9b2d-0a5569f5cdd0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Request method failure captured: Aug 24 03:56:49.131159 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: request: DELETE /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70/os-volume_attachments/0169d1b4-a937-48d3-94ab-dd92b5a558a3 HTTP/1.1 Aug 24 03:56:49.131159 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept: application/json Aug 24 03:56:49.131159 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept-Encoding: identity Aug 24 03:56:49.131159 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Connection: close Aug 24 03:56:49.131159 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Length: 0 Aug 24 03:56:49.131159 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Type: application/json Aug 24 03:56:49.131159 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Host: 10.222.0.82 Aug 24 03:56:49.131159 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Openstack-System-Scope: None Aug 24 03:56:49.131159 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: User-Agent: python-urllib3/1.26.11 Aug 24 03:56:49.131159 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Auth-Token: gAAAAABjBaBwfFwtOW_HqduVs-Y72_nB0AfAGPkKiTC3c4uSLXKyBQUeIsdjnKcKqOXOXGzaPm3531c8BOjXNm1ZmlI5tsEEAgDjb8e71EXHI4eXRLl99FfDJSPPx9GmrFEVoPYMPEhZvpFFVWFOIsIGclHl28xUAF2supcEcrqrvkfNAW9RaN4 Aug 24 03:56:49.131159 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Id: None Aug 24 03:56:49.131159 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Name: None Aug 24 03:56:49.131159 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Identity-Status: Confirmed Aug 24 03:56:49.131159 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Is-Admin-Project: True Aug 24 03:56:49.131159 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Id: default Aug 24 03:56:49.131159 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Name: Default Aug 24 03:56:49.131159 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Id: 63408551e1b24a86b8f0059f1a948896 Aug 24 03:56:49.131159 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-496383813 Aug 24 03:56:49.131159 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Role: member,reader Aug 24 03:56:49.131159 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Roles: member,reader Aug 24 03:56:49.132874 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/63408551e1b24a86b8f0059f1a948896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/63408551e1b24a86b8f0059f1a948896"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/63408551e1b24a86b8f0059f1a948896"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_63408551e1b24a86b8f0059f1a948896", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:56:49.132874 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant: tempest-ServerRescueNegativeTestJSON-496383813 Aug 24 03:56:49.132874 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Id: 63408551e1b24a86b8f0059f1a948896 Aug 24 03:56:49.132874 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-496383813 Aug 24 03:56:49.132874 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User: tempest-ServerRescueNegativeTestJSON-496383813-project Aug 24 03:56:49.132874 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Id: default Aug 24 03:56:49.132874 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Name: Default Aug 24 03:56:49.132874 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Id: 547bce0d8133462c95bcb6f272776a27 Aug 24 03:56:49.132874 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Name: tempest-ServerRescueNegativeTestJSON-496383813-project Aug 24 03:56:49.132874 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: method: > Aug 24 03:56:49.132874 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: exception: Cannot 'detach_volume' instance 95c868c4-fc26-429b-8f03-9edf2d7e8a70 while it is in vm_state rescued Aug 24 03:56:49.133973 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: action_args: {'server_id': '95c868c4-fc26-429b-8f03-9edf2d7e8a70', 'id': '0169d1b4-a937-48d3-94ab-dd92b5a558a3'} Aug 24 03:56:49.133973 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:56:49.133973 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:56:49.133973 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 03:56:49.133973 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 03:56:49.133973 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 03:56:49.133973 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 03:56:49.133973 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 03:56:49.133973 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 03:56:49.133973 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 95c868c4-fc26-429b-8f03-9edf2d7e8a70 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 03:56:49.133973 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:56:49.133973 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:56:49.133973 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:56:49.133973 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:56:49.133973 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:56:49.133973 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:56:49.133973 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:56:49.133973 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:56:49.133973 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:56:49.133973 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:56:49.135433 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 03:56:49.135433 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 03:56:49.135433 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 03:56:49.135433 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 03:56:49.135433 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 95c868c4-fc26-429b-8f03-9edf2d7e8a70 while it is in vm_state rescued Aug 24 03:56:49.135433 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:56:49.135433 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:56:49.135433 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:56:49.135433 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:56:49.135433 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:56:49.135433 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:56:49.135433 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:56:49.135433 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:56:49.135433 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 95c868c4-fc26-429b-8f03-9edf2d7e8a70 while it is in vm_state rescued Aug 24 03:56:49.135433 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:56:49.135433 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-751cc75e-1fe7-4570-9b2d-0a5569f5cdd0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Returning 409 to user: Cannot 'detach_volume' instance 95c868c4-fc26-429b-8f03-9edf2d7e8a70 while it is in vm_state rescued {{(pid=127869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:56:49.136579 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-751cc75e-1fe7-4570-9b2d-0a5569f5cdd0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "DELETE /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70/os-volume_attachments/0169d1b4-a937-48d3-94ab-dd92b5a558a3" status: 409 len: 152 microversion: 2.1 time: 0.143273 Aug 24 03:56:49.136579 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 303/609] 10.222.0.82 () {58 vars in 1416 bytes} [Wed Aug 24 03:56:48 2022] DELETE /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70/os-volume_attachments/0169d1b4-a937-48d3-94ab-dd92b5a558a3 => generated 152 bytes in 144 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:56:49.141935 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-89f9febd-016e-49b6-a60e-5f0e26532412 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:56:49.142471 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-89f9febd-016e-49b6-a60e-5f0e26532412 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:49.148629 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-89f9febd-016e-49b6-a60e-5f0e26532412 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:49.149114 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-89f9febd-016e-49b6-a60e-5f0e26532412 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:49.149551 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-89f9febd-016e-49b6-a60e-5f0e26532412 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:49.150240 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-89f9febd-016e-49b6-a60e-5f0e26532412 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:49.150754 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-89f9febd-016e-49b6-a60e-5f0e26532412 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:49.151180 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-89f9febd-016e-49b6-a60e-5f0e26532412 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:49.240158 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-be13d8e9-87e7-456b-8086-9303a0c4d377 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:49.241428 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-be13d8e9-87e7-456b-8086-9303a0c4d377 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 0109332f-80ab-4d03-ba4d-1a24fc88fcf1] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:49.247607 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-be13d8e9-87e7-456b-8086-9303a0c4d377 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:49.248084 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-be13d8e9-87e7-456b-8086-9303a0c4d377 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:49.248514 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-be13d8e9-87e7-456b-8086-9303a0c4d377 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:49.249198 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-be13d8e9-87e7-456b-8086-9303a0c4d377 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:49.249639 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-be13d8e9-87e7-456b-8086-9303a0c4d377 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:49.250057 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-be13d8e9-87e7-456b-8086-9303a0c4d377 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:49.382840 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-be13d8e9-87e7-456b-8086-9303a0c4d377 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:49.390748 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-be13d8e9-87e7-456b-8086-9303a0c4d377 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1" status: 200 len: 1366 microversion: 2.1 time: 0.154521 Aug 24 03:56:49.391655 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 304/610] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:49 2022] GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:56:49.474650 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-89f9febd-016e-49b6-a60e-5f0e26532412 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "POST /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70/action" status: 202 len: 0 microversion: 2.1 time: 0.336339 Aug 24 03:56:49.475289 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 307/611] 10.222.0.82 () {60 vars in 1278 bytes} [Wed Aug 24 03:56:49 2022] POST /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70/action => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:56:49.484203 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-6e05e1f2-5858-4598-a795-7f4356413a52 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:49.484809 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-6e05e1f2-5858-4598-a795-7f4356413a52 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:49.490930 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6e05e1f2-5858-4598-a795-7f4356413a52 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:49.491395 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6e05e1f2-5858-4598-a795-7f4356413a52 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:49.491962 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6e05e1f2-5858-4598-a795-7f4356413a52 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:49.492678 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6e05e1f2-5858-4598-a795-7f4356413a52 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:49.493130 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6e05e1f2-5858-4598-a795-7f4356413a52 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:49.493551 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6e05e1f2-5858-4598-a795-7f4356413a52 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:49.625727 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-6e05e1f2-5858-4598-a795-7f4356413a52 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:49.635209 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-6e05e1f2-5858-4598-a795-7f4356413a52 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1721 microversion: 2.1 time: 0.154812 Aug 24 03:56:49.635772 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 305/612] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:49 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:49.770014 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-eccc4f3a-f8cd-4ede-b31f-5ac1d25ef29d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:49.770669 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-eccc4f3a-f8cd-4ede-b31f-5ac1d25ef29d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:49.777924 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eccc4f3a-f8cd-4ede-b31f-5ac1d25ef29d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:49.778403 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eccc4f3a-f8cd-4ede-b31f-5ac1d25ef29d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:49.778869 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eccc4f3a-f8cd-4ede-b31f-5ac1d25ef29d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:49.779553 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eccc4f3a-f8cd-4ede-b31f-5ac1d25ef29d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:49.780008 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eccc4f3a-f8cd-4ede-b31f-5ac1d25ef29d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:49.780430 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eccc4f3a-f8cd-4ede-b31f-5ac1d25ef29d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:49.847830 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-eccc4f3a-f8cd-4ede-b31f-5ac1d25ef29d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:49.856465 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-eccc4f3a-f8cd-4ede-b31f-5ac1d25ef29d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:49.857951 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-eccc4f3a-f8cd-4ede-b31f-5ac1d25ef29d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:49.859086 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-eccc4f3a-f8cd-4ede-b31f-5ac1d25ef29d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1333 microversion: 2.20 time: 0.093578 Aug 24 03:56:49.859631 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 308/613] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:49 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1333 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:50.412236 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-b4a2b25f-7d5d-4fe7-a9ba-2ecfc96f8a4d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:50.412838 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-b4a2b25f-7d5d-4fe7-a9ba-2ecfc96f8a4d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 0109332f-80ab-4d03-ba4d-1a24fc88fcf1] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:50.419398 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b4a2b25f-7d5d-4fe7-a9ba-2ecfc96f8a4d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:50.419877 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b4a2b25f-7d5d-4fe7-a9ba-2ecfc96f8a4d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:50.420308 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b4a2b25f-7d5d-4fe7-a9ba-2ecfc96f8a4d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:50.421095 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b4a2b25f-7d5d-4fe7-a9ba-2ecfc96f8a4d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:50.421553 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b4a2b25f-7d5d-4fe7-a9ba-2ecfc96f8a4d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:50.421988 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b4a2b25f-7d5d-4fe7-a9ba-2ecfc96f8a4d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:50.557995 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-b4a2b25f-7d5d-4fe7-a9ba-2ecfc96f8a4d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:50.565767 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-b4a2b25f-7d5d-4fe7-a9ba-2ecfc96f8a4d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1" status: 200 len: 1366 microversion: 2.1 time: 0.157389 Aug 24 03:56:50.566801 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 306/614] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:50 2022] GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:50.656951 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bf44bb41-7cb0-4574-b4a5-1d7d37068e18 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:50.657556 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bf44bb41-7cb0-4574-b4a5-1d7d37068e18 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:50.664195 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf44bb41-7cb0-4574-b4a5-1d7d37068e18 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:50.664729 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf44bb41-7cb0-4574-b4a5-1d7d37068e18 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:50.665168 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf44bb41-7cb0-4574-b4a5-1d7d37068e18 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:50.665958 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf44bb41-7cb0-4574-b4a5-1d7d37068e18 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:50.666300 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf44bb41-7cb0-4574-b4a5-1d7d37068e18 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:50.666738 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf44bb41-7cb0-4574-b4a5-1d7d37068e18 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:50.798813 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-bf44bb41-7cb0-4574-b4a5-1d7d37068e18 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:50.807050 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bf44bb41-7cb0-4574-b4a5-1d7d37068e18 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1721 microversion: 2.1 time: 0.153707 Aug 24 03:56:50.807534 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 309/615] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:50 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:50.882464 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-be6f8ff7-13cb-4de4-ac9e-c6e52e8523cb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:50.883682 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-be6f8ff7-13cb-4de4-ac9e-c6e52e8523cb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:50.890176 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-be6f8ff7-13cb-4de4-ac9e-c6e52e8523cb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:50.890693 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-be6f8ff7-13cb-4de4-ac9e-c6e52e8523cb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:50.891124 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-be6f8ff7-13cb-4de4-ac9e-c6e52e8523cb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:50.891812 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-be6f8ff7-13cb-4de4-ac9e-c6e52e8523cb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:50.892251 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-be6f8ff7-13cb-4de4-ac9e-c6e52e8523cb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:50.892665 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-be6f8ff7-13cb-4de4-ac9e-c6e52e8523cb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:50.957220 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-be6f8ff7-13cb-4de4-ac9e-c6e52e8523cb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:50.965654 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-be6f8ff7-13cb-4de4-ac9e-c6e52e8523cb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:50.967188 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-be6f8ff7-13cb-4de4-ac9e-c6e52e8523cb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:50.968285 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-be6f8ff7-13cb-4de4-ac9e-c6e52e8523cb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1341 microversion: 2.20 time: 0.090777 Aug 24 03:56:50.968841 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 307/616] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:50 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1341 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:51.587535 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2cfb630b-a3ad-48e0-9033-b4c4b1ba4e9e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:51.588156 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2cfb630b-a3ad-48e0-9033-b4c4b1ba4e9e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 0109332f-80ab-4d03-ba4d-1a24fc88fcf1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:51.594079 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2cfb630b-a3ad-48e0-9033-b4c4b1ba4e9e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:51.594620 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2cfb630b-a3ad-48e0-9033-b4c4b1ba4e9e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:51.595053 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2cfb630b-a3ad-48e0-9033-b4c4b1ba4e9e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:51.595740 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2cfb630b-a3ad-48e0-9033-b4c4b1ba4e9e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:51.596187 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2cfb630b-a3ad-48e0-9033-b4c4b1ba4e9e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:51.596608 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2cfb630b-a3ad-48e0-9033-b4c4b1ba4e9e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:51.732129 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-2cfb630b-a3ad-48e0-9033-b4c4b1ba4e9e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:51.740391 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2cfb630b-a3ad-48e0-9033-b4c4b1ba4e9e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1" status: 200 len: 1557 microversion: 2.1 time: 0.157293 Aug 24 03:56:51.740954 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 310/617] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:51 2022] GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1 => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:56:51.761808 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-2c1517fd-5a48-4e03-94f3-e8e834dfb1af tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:51.762379 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-2c1517fd-5a48-4e03-94f3-e8e834dfb1af tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 0109332f-80ab-4d03-ba4d-1a24fc88fcf1] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:51.768292 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2c1517fd-5a48-4e03-94f3-e8e834dfb1af tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:51.768770 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2c1517fd-5a48-4e03-94f3-e8e834dfb1af tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:51.769200 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2c1517fd-5a48-4e03-94f3-e8e834dfb1af tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:51.769885 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2c1517fd-5a48-4e03-94f3-e8e834dfb1af tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:51.770330 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2c1517fd-5a48-4e03-94f3-e8e834dfb1af tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:51.770958 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2c1517fd-5a48-4e03-94f3-e8e834dfb1af tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:51.828764 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2e47f438-772a-4147-b99e-1e46435b89bc tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:51.829379 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2e47f438-772a-4147-b99e-1e46435b89bc tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:51.837043 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2e47f438-772a-4147-b99e-1e46435b89bc tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:51.837601 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2e47f438-772a-4147-b99e-1e46435b89bc tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:51.838037 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2e47f438-772a-4147-b99e-1e46435b89bc tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:51.839159 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2e47f438-772a-4147-b99e-1e46435b89bc tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:51.839790 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2e47f438-772a-4147-b99e-1e46435b89bc tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:51.840399 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2e47f438-772a-4147-b99e-1e46435b89bc tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:51.862025 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:51.993116 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-2e47f438-772a-4147-b99e-1e46435b89bc tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:52.006770 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2e47f438-772a-4147-b99e-1e46435b89bc tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1721 microversion: 2.1 time: 0.181938 Aug 24 03:56:52.009734 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 311/618] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:51 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:56:52.019448 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-73c80217-6645-4fbe-bcdb-b6fdfe728650 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:52.020368 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-73c80217-6645-4fbe-bcdb-b6fdfe728650 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:52.028302 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73c80217-6645-4fbe-bcdb-b6fdfe728650 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:52.028788 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73c80217-6645-4fbe-bcdb-b6fdfe728650 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:52.029222 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73c80217-6645-4fbe-bcdb-b6fdfe728650 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:52.029924 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73c80217-6645-4fbe-bcdb-b6fdfe728650 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:52.030374 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73c80217-6645-4fbe-bcdb-b6fdfe728650 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:52.030823 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73c80217-6645-4fbe-bcdb-b6fdfe728650 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:52.136660 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-2c1517fd-5a48-4e03-94f3-e8e834dfb1af tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.379406 Aug 24 03:56:52.137584 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 308/619] 10.222.0.82 () {58 vars in 1275 bytes} [Wed Aug 24 03:56:51 2022] GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1/os-interface => generated 285 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:56:52.254237 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-73c80217-6645-4fbe-bcdb-b6fdfe728650 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:52.264262 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-73c80217-6645-4fbe-bcdb-b6fdfe728650 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:52.265859 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-73c80217-6645-4fbe-bcdb-b6fdfe728650 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:52.267040 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-73c80217-6645-4fbe-bcdb-b6fdfe728650 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1406 microversion: 2.20 time: 0.256153 Aug 24 03:56:52.267604 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 312/620] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:52 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1406 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:53.030934 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-bff21dc0-84e5-4ba4-b39d-23c86f713d52 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:53.031651 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-bff21dc0-84e5-4ba4-b39d-23c86f713d52 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:53.037737 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bff21dc0-84e5-4ba4-b39d-23c86f713d52 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:53.038314 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bff21dc0-84e5-4ba4-b39d-23c86f713d52 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:53.038915 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bff21dc0-84e5-4ba4-b39d-23c86f713d52 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:53.040356 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bff21dc0-84e5-4ba4-b39d-23c86f713d52 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:53.040829 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bff21dc0-84e5-4ba4-b39d-23c86f713d52 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:53.041258 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bff21dc0-84e5-4ba4-b39d-23c86f713d52 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:53.137627 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-90364a0a-9c2c-450b-bd02-b58d4b673051 req-97073331-d09e-45ba-a7b9-ab123f48674e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0109332f-80ab-4d03-ba4d-1a24fc88fcf1", "tag": "6fb7eefd-3c2e-44a9-aa1e-a1eba153d019"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:56:53.147815 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-90364a0a-9c2c-450b-bd02-b58d4b673051 req-97073331-d09e-45ba-a7b9-ab123f48674e service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:53.148927 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-90364a0a-9c2c-450b-bd02-b58d4b673051 req-97073331-d09e-45ba-a7b9-ab123f48674e service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:53.149457 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-90364a0a-9c2c-450b-bd02-b58d4b673051 req-97073331-d09e-45ba-a7b9-ab123f48674e service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:53.161194 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-90364a0a-9c2c-450b-bd02-b58d4b673051 req-97073331-d09e-45ba-a7b9-ab123f48674e service nova] Creating event network-changed:6fb7eefd-3c2e-44a9-aa1e-a1eba153d019 for instance 0109332f-80ab-4d03-ba4d-1a24fc88fcf1 on hv-cinder-85426 Aug 24 03:56:53.169210 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-90364a0a-9c2c-450b-bd02-b58d4b673051 req-97073331-d09e-45ba-a7b9-ab123f48674e service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034642 Aug 24 03:56:53.170125 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 313/621] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:56:53.265514 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-bff21dc0-84e5-4ba4-b39d-23c86f713d52 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:53.275933 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-bff21dc0-84e5-4ba4-b39d-23c86f713d52 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1721 microversion: 2.1 time: 0.249262 Aug 24 03:56:53.276517 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 309/622] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:53 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1721 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:53.296981 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-84298fa5-afd8-4a33-961c-73bd24bb55f6 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:53.297677 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-84298fa5-afd8-4a33-961c-73bd24bb55f6 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:53.306143 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-84298fa5-afd8-4a33-961c-73bd24bb55f6 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:53.306825 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-84298fa5-afd8-4a33-961c-73bd24bb55f6 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:53.307268 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-84298fa5-afd8-4a33-961c-73bd24bb55f6 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:53.307984 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-84298fa5-afd8-4a33-961c-73bd24bb55f6 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:53.308586 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-84298fa5-afd8-4a33-961c-73bd24bb55f6 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:53.309019 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-84298fa5-afd8-4a33-961c-73bd24bb55f6 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:53.475438 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-84298fa5-afd8-4a33-961c-73bd24bb55f6 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:53.484870 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-84298fa5-afd8-4a33-961c-73bd24bb55f6 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:53.486726 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-84298fa5-afd8-4a33-961c-73bd24bb55f6 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:53.487896 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-84298fa5-afd8-4a33-961c-73bd24bb55f6 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1406 microversion: 2.20 time: 0.195383 Aug 24 03:56:53.488815 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 314/623] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:53 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1406 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:53.861433 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-f30a6b87-a72a-4504-89b4-c3cd6fced0ba req-cee6d425-6767-42f7-8404-e286500feadf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df85e6fe-54b4-456b-875d-7c3b6418c40e", "tag": "b70bff9a-be9c-4b03-8c48-2151d8730e62"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:56:53.871462 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:53.874209 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-f30a6b87-a72a-4504-89b4-c3cd6fced0ba req-cee6d425-6767-42f7-8404-e286500feadf service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:53.874792 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-f30a6b87-a72a-4504-89b4-c3cd6fced0ba req-cee6d425-6767-42f7-8404-e286500feadf service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:53.875800 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-f30a6b87-a72a-4504-89b4-c3cd6fced0ba req-cee6d425-6767-42f7-8404-e286500feadf service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:53.888507 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-f30a6b87-a72a-4504-89b4-c3cd6fced0ba req-cee6d425-6767-42f7-8404-e286500feadf service nova] Creating event network-changed:b70bff9a-be9c-4b03-8c48-2151d8730e62 for instance df85e6fe-54b4-456b-875d-7c3b6418c40e on hv-cinder-85426 Aug 24 03:56:53.894040 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-f30a6b87-a72a-4504-89b4-c3cd6fced0ba req-cee6d425-6767-42f7-8404-e286500feadf service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036448 Aug 24 03:56:53.894833 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 310/624] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:56:54.300471 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cf059511-7360-4bd5-a79b-120d1c2b9a56 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:54.301072 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cf059511-7360-4bd5-a79b-120d1c2b9a56 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:54.303288 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:54.308986 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf059511-7360-4bd5-a79b-120d1c2b9a56 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:54.310957 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf059511-7360-4bd5-a79b-120d1c2b9a56 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:54.311642 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf059511-7360-4bd5-a79b-120d1c2b9a56 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:54.312100 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf059511-7360-4bd5-a79b-120d1c2b9a56 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:54.312861 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf059511-7360-4bd5-a79b-120d1c2b9a56 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:54.312988 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cf059511-7360-4bd5-a79b-120d1c2b9a56 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:54.512811 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-bacc8abd-7423-411c-b267-ceb11cd690f0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:54.513505 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-bacc8abd-7423-411c-b267-ceb11cd690f0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:54.521633 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bacc8abd-7423-411c-b267-ceb11cd690f0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:54.522337 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bacc8abd-7423-411c-b267-ceb11cd690f0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:54.522969 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bacc8abd-7423-411c-b267-ceb11cd690f0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:54.523679 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bacc8abd-7423-411c-b267-ceb11cd690f0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:54.524135 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bacc8abd-7423-411c-b267-ceb11cd690f0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:54.524575 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bacc8abd-7423-411c-b267-ceb11cd690f0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:54.533746 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-cf059511-7360-4bd5-a79b-120d1c2b9a56 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:54.542812 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cf059511-7360-4bd5-a79b-120d1c2b9a56 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1727 microversion: 2.1 time: 0.246172 Aug 24 03:56:54.543641 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 315/625] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:54 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1727 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:56:54.567941 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e5a7cc95-ec17-4a55-bc61-055df2bdb118 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:54.568429 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e5a7cc95-ec17-4a55-bc61-055df2bdb118 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:54.574950 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e5a7cc95-ec17-4a55-bc61-055df2bdb118 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:54.579661 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e5a7cc95-ec17-4a55-bc61-055df2bdb118 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:54.579661 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e5a7cc95-ec17-4a55-bc61-055df2bdb118 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:54.579661 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e5a7cc95-ec17-4a55-bc61-055df2bdb118 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:54.579661 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e5a7cc95-ec17-4a55-bc61-055df2bdb118 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:54.580165 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e5a7cc95-ec17-4a55-bc61-055df2bdb118 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:54.661206 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e5a7cc95-ec17-4a55-bc61-055df2bdb118 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097049 Aug 24 03:56:54.661863 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 316/626] 10.222.0.82 () {58 vars in 1275 bytes} [Wed Aug 24 03:56:54 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:56:54.866452 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-bacc8abd-7423-411c-b267-ceb11cd690f0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:54.875500 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-bacc8abd-7423-411c-b267-ceb11cd690f0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:54.877052 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-bacc8abd-7423-411c-b267-ceb11cd690f0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:54.878190 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-bacc8abd-7423-411c-b267-ceb11cd690f0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1406 microversion: 2.20 time: 0.370562 Aug 24 03:56:54.878785 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 311/627] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:54 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1406 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:56:55.903345 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3d77f82f-b149-4ed5-9b03-b9460b112a0d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:55.903963 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3d77f82f-b149-4ed5-9b03-b9460b112a0d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:55.909795 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-fc577cf1-f3ad-4e0f-bb50-fa83a9b1ef01 req-39c20975-705c-4aee-83f6-6ed19734b610 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95c868c4-fc26-429b-8f03-9edf2d7e8a70", "tag": "1d5cfffb-87d1-418d-8955-91c69e97af1e"}, {"name": "network-changed", "server_uuid": "95c868c4-fc26-429b-8f03-9edf2d7e8a70", "tag": "1d5cfffb-87d1-418d-8955-91c69e97af1e"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:56:55.910317 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3d77f82f-b149-4ed5-9b03-b9460b112a0d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:55.910823 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3d77f82f-b149-4ed5-9b03-b9460b112a0d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:55.911254 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3d77f82f-b149-4ed5-9b03-b9460b112a0d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:55.911941 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3d77f82f-b149-4ed5-9b03-b9460b112a0d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:55.912583 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3d77f82f-b149-4ed5-9b03-b9460b112a0d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:55.913009 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3d77f82f-b149-4ed5-9b03-b9460b112a0d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:55.920734 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-fc577cf1-f3ad-4e0f-bb50-fa83a9b1ef01 req-39c20975-705c-4aee-83f6-6ed19734b610 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:55.921618 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-fc577cf1-f3ad-4e0f-bb50-fa83a9b1ef01 req-39c20975-705c-4aee-83f6-6ed19734b610 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:55.922146 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-fc577cf1-f3ad-4e0f-bb50-fa83a9b1ef01 req-39c20975-705c-4aee-83f6-6ed19734b610 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:55.934549 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-fc577cf1-f3ad-4e0f-bb50-fa83a9b1ef01 req-39c20975-705c-4aee-83f6-6ed19734b610 service nova] Creating event network-changed:1d5cfffb-87d1-418d-8955-91c69e97af1e for instance 95c868c4-fc26-429b-8f03-9edf2d7e8a70 on hv-cinder-85426 Aug 24 03:56:55.935163 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-fc577cf1-f3ad-4e0f-bb50-fa83a9b1ef01 req-39c20975-705c-4aee-83f6-6ed19734b610 service nova] Creating event network-changed:1d5cfffb-87d1-418d-8955-91c69e97af1e for instance 95c868c4-fc26-429b-8f03-9edf2d7e8a70 on hv-cinder-85426 Aug 24 03:56:55.940225 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-fc577cf1-f3ad-4e0f-bb50-fa83a9b1ef01 req-39c20975-705c-4aee-83f6-6ed19734b610 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.034075 Aug 24 03:56:55.940812 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 312/628] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:56:56.045815 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-3d77f82f-b149-4ed5-9b03-b9460b112a0d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:56.053968 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-3d77f82f-b149-4ed5-9b03-b9460b112a0d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:56.056767 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-3d77f82f-b149-4ed5-9b03-b9460b112a0d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:56.057942 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3d77f82f-b149-4ed5-9b03-b9460b112a0d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1406 microversion: 2.20 time: 0.160546 Aug 24 03:56:56.058526 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 317/629] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:55 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:57.081596 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-34b73e88-3d58-42bd-858b-270b86fa9ae5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:57.082317 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-34b73e88-3d58-42bd-858b-270b86fa9ae5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:57.089228 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-34b73e88-3d58-42bd-858b-270b86fa9ae5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:57.089714 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-34b73e88-3d58-42bd-858b-270b86fa9ae5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:57.090195 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-34b73e88-3d58-42bd-858b-270b86fa9ae5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:57.090913 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-34b73e88-3d58-42bd-858b-270b86fa9ae5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:57.091357 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-34b73e88-3d58-42bd-858b-270b86fa9ae5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:57.091776 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-34b73e88-3d58-42bd-858b-270b86fa9ae5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:57.112469 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell1:SELECT=100 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:57.302392 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-34b73e88-3d58-42bd-858b-270b86fa9ae5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:57.310716 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-34b73e88-3d58-42bd-858b-270b86fa9ae5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:57.312265 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-34b73e88-3d58-42bd-858b-270b86fa9ae5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:57.313375 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-34b73e88-3d58-42bd-858b-270b86fa9ae5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1406 microversion: 2.20 time: 0.236812 Aug 24 03:56:57.313929 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 313/630] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:57 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1406 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:58.337124 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d0940bb9-b364-42c6-86c8-424083be453a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:58.337839 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d0940bb9-b364-42c6-86c8-424083be453a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:58.344074 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d0940bb9-b364-42c6-86c8-424083be453a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:58.344551 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d0940bb9-b364-42c6-86c8-424083be453a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:58.344981 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d0940bb9-b364-42c6-86c8-424083be453a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:58.345661 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d0940bb9-b364-42c6-86c8-424083be453a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:58.346110 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d0940bb9-b364-42c6-86c8-424083be453a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:58.346567 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d0940bb9-b364-42c6-86c8-424083be453a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:58.483056 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-d0940bb9-b364-42c6-86c8-424083be453a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:58.491297 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-d0940bb9-b364-42c6-86c8-424083be453a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:58.492822 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-d0940bb9-b364-42c6-86c8-424083be453a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:58.493912 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d0940bb9-b364-42c6-86c8-424083be453a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1406 microversion: 2.20 time: 0.161435 Aug 24 03:56:58.494468 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 318/631] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:58 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:59.517088 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-d884d1f3-9f3f-4c05-b634-230067c4c312 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:59.517690 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-d884d1f3-9f3f-4c05-b634-230067c4c312 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:59.519528 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell0:SELECT=2 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:59.520219 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell0:SELECT=8 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:59.527353 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d884d1f3-9f3f-4c05-b634-230067c4c312 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:59.527839 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d884d1f3-9f3f-4c05-b634-230067c4c312 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:59.528274 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d884d1f3-9f3f-4c05-b634-230067c4c312 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:59.528964 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d884d1f3-9f3f-4c05-b634-230067c4c312 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:59.529412 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d884d1f3-9f3f-4c05-b634-230067c4c312 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:59.529838 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d884d1f3-9f3f-4c05-b634-230067c4c312 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:59.666675 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-d884d1f3-9f3f-4c05-b634-230067c4c312 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:59.673354 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-d884d1f3-9f3f-4c05-b634-230067c4c312 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:59.674903 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-d884d1f3-9f3f-4c05-b634-230067c4c312 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:59.676069 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-d884d1f3-9f3f-4c05-b634-230067c4c312 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1406 microversion: 2.20 time: 0.162834 Aug 24 03:56:59.676561 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 314/632] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:59 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:57:00.339835 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-cc511d5d-343d-40d0-99c2-3f4b704283a0 req-a86379e1-731b-432f-8717-e51938b79580 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df85e6fe-54b4-456b-875d-7c3b6418c40e", "name": "network-vif-plugged", "status": "completed", "tag": "b70bff9a-be9c-4b03-8c48-2151d8730e62"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:00.349331 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-cc511d5d-343d-40d0-99c2-3f4b704283a0 req-a86379e1-731b-432f-8717-e51938b79580 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:00.352806 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-cc511d5d-343d-40d0-99c2-3f4b704283a0 req-a86379e1-731b-432f-8717-e51938b79580 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:00.352806 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-cc511d5d-343d-40d0-99c2-3f4b704283a0 req-a86379e1-731b-432f-8717-e51938b79580 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:00.361603 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-cc511d5d-343d-40d0-99c2-3f4b704283a0 req-a86379e1-731b-432f-8717-e51938b79580 service nova] Creating event network-vif-plugged:b70bff9a-be9c-4b03-8c48-2151d8730e62 for instance df85e6fe-54b4-456b-875d-7c3b6418c40e on hv-cinder-85426 Aug 24 03:57:00.366988 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-cc511d5d-343d-40d0-99c2-3f4b704283a0 req-a86379e1-731b-432f-8717-e51938b79580 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031146 Aug 24 03:57:00.367580 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 319/633] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:00.699428 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-2d0a2011-72e8-4fd7-9751-32599850df77 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:00.700068 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-2d0a2011-72e8-4fd7-9751-32599850df77 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:00.706429 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2d0a2011-72e8-4fd7-9751-32599850df77 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:00.706947 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2d0a2011-72e8-4fd7-9751-32599850df77 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:00.707383 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2d0a2011-72e8-4fd7-9751-32599850df77 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:00.708068 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2d0a2011-72e8-4fd7-9751-32599850df77 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:00.708526 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2d0a2011-72e8-4fd7-9751-32599850df77 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:00.711315 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2d0a2011-72e8-4fd7-9751-32599850df77 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:01.144919 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-2d0a2011-72e8-4fd7-9751-32599850df77 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:01.153803 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-2d0a2011-72e8-4fd7-9751-32599850df77 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:01.155366 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-2d0a2011-72e8-4fd7-9751-32599850df77 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:01.156526 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-2d0a2011-72e8-4fd7-9751-32599850df77 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1406 microversion: 2.20 time: 0.461051 Aug 24 03:57:01.157063 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 315/634] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:00 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1406 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:57:02.180731 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-eff11494-9be7-49b1-9f4f-51897dd63afd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:02.181450 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-eff11494-9be7-49b1-9f4f-51897dd63afd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:02.187692 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eff11494-9be7-49b1-9f4f-51897dd63afd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:02.188177 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eff11494-9be7-49b1-9f4f-51897dd63afd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:02.188609 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eff11494-9be7-49b1-9f4f-51897dd63afd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:02.189305 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eff11494-9be7-49b1-9f4f-51897dd63afd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:02.189760 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eff11494-9be7-49b1-9f4f-51897dd63afd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:02.190184 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-eff11494-9be7-49b1-9f4f-51897dd63afd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:02.487944 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-eff11494-9be7-49b1-9f4f-51897dd63afd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:02.497758 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-eff11494-9be7-49b1-9f4f-51897dd63afd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:02.499280 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-eff11494-9be7-49b1-9f4f-51897dd63afd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:02.500477 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-eff11494-9be7-49b1-9f4f-51897dd63afd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1406 microversion: 2.20 time: 0.324756 Aug 24 03:57:02.501029 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 320/635] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:02 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1406 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:57:03.523193 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-12c7706d-32b9-421e-9b29-345d6b89a135 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:03.523765 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-12c7706d-32b9-421e-9b29-345d6b89a135 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:03.530185 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-12c7706d-32b9-421e-9b29-345d6b89a135 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:03.532518 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-12c7706d-32b9-421e-9b29-345d6b89a135 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:03.532518 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-12c7706d-32b9-421e-9b29-345d6b89a135 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:03.532518 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-12c7706d-32b9-421e-9b29-345d6b89a135 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:03.532518 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-12c7706d-32b9-421e-9b29-345d6b89a135 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:03.532868 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-12c7706d-32b9-421e-9b29-345d6b89a135 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:03.723645 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-12c7706d-32b9-421e-9b29-345d6b89a135 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:03.732293 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-12c7706d-32b9-421e-9b29-345d6b89a135 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:03.733800 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-12c7706d-32b9-421e-9b29-345d6b89a135 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:03.734981 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-12c7706d-32b9-421e-9b29-345d6b89a135 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1599 microversion: 2.20 time: 0.215833 Aug 24 03:57:03.735543 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 316/636] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:03 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1599 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:57:03.759019 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6f19afef-c1b9-458d-9afd-d6fc8afa895e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:03.759538 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6f19afef-c1b9-458d-9afd-d6fc8afa895e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:03.765915 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6f19afef-c1b9-458d-9afd-d6fc8afa895e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:03.766393 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6f19afef-c1b9-458d-9afd-d6fc8afa895e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:03.766933 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6f19afef-c1b9-458d-9afd-d6fc8afa895e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:03.767628 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6f19afef-c1b9-458d-9afd-d6fc8afa895e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:03.768085 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6f19afef-c1b9-458d-9afd-d6fc8afa895e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:03.768513 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6f19afef-c1b9-458d-9afd-d6fc8afa895e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:03.849592 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6f19afef-c1b9-458d-9afd-d6fc8afa895e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.095696 Aug 24 03:57:03.850225 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 321/637] 10.222.0.82 () {60 vars in 1316 bytes} [Wed Aug 24 03:57:03 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:57:04.839979 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-011c6bff-14cc-45d3-a11b-3751d5a415fa req-dc73070a-c946-411f-8f80-fda6d47cfcd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df85e6fe-54b4-456b-875d-7c3b6418c40e", "tag": "b70bff9a-be9c-4b03-8c48-2151d8730e62"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:04.849812 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-011c6bff-14cc-45d3-a11b-3751d5a415fa req-dc73070a-c946-411f-8f80-fda6d47cfcd3 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:04.850408 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-011c6bff-14cc-45d3-a11b-3751d5a415fa req-dc73070a-c946-411f-8f80-fda6d47cfcd3 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:04.851519 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-011c6bff-14cc-45d3-a11b-3751d5a415fa req-dc73070a-c946-411f-8f80-fda6d47cfcd3 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:04.862602 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-011c6bff-14cc-45d3-a11b-3751d5a415fa req-dc73070a-c946-411f-8f80-fda6d47cfcd3 service nova] Creating event network-changed:b70bff9a-be9c-4b03-8c48-2151d8730e62 for instance df85e6fe-54b4-456b-875d-7c3b6418c40e on hv-cinder-85426 Aug 24 03:57:04.868088 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-011c6bff-14cc-45d3-a11b-3751d5a415fa req-dc73070a-c946-411f-8f80-fda6d47cfcd3 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033110 Aug 24 03:57:04.868885 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 317/638] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:10.517632 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-faf6059e-1033-4aea-8aed-1b44f1c89be9 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-184954190"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:10.518210 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-faf6059e-1033-4aea-8aed-1b44f1c89be9 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:10.520225 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:10.525399 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-faf6059e-1033-4aea-8aed-1b44f1c89be9 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:10.525881 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-faf6059e-1033-4aea-8aed-1b44f1c89be9 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:10.526321 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-faf6059e-1033-4aea-8aed-1b44f1c89be9 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:10.527039 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-faf6059e-1033-4aea-8aed-1b44f1c89be9 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:10.527496 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-faf6059e-1033-4aea-8aed-1b44f1c89be9 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:10.527923 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-faf6059e-1033-4aea-8aed-1b44f1c89be9 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:10.656606 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.network.security_group_api [None req-faf6059e-1033-4aea-8aed-1b44f1c89be9 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Removing security group 9aa9ac00-7c3d-4bd4-b90c-242a0112acdc from port 1e23267f-b4be-439b-aa5f-3dbc95900806 Aug 24 03:57:11.067065 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-faf6059e-1033-4aea-8aed-1b44f1c89be9 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "POST /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7/action" status: 202 len: 0 microversion: 2.1 time: 0.554085 Aug 24 03:57:11.067715 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 322/639] 10.222.0.82 () {60 vars in 1278 bytes} [Wed Aug 24 03:57:10 2022] POST /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7/action => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:57:11.078872 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-9aa359f9-01a1-4ff0-a413-a0b07cfd5bce req-7b8d966a-1552-4321-b39a-645b6c6db908 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0e4f072-3d61-4169-aba1-decacb716ac7", "tag": "1e23267f-b4be-439b-aa5f-3dbc95900806"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:11.090874 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-9aa359f9-01a1-4ff0-a413-a0b07cfd5bce req-7b8d966a-1552-4321-b39a-645b6c6db908 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:11.091357 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-9aa359f9-01a1-4ff0-a413-a0b07cfd5bce req-7b8d966a-1552-4321-b39a-645b6c6db908 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:11.091786 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-9aa359f9-01a1-4ff0-a413-a0b07cfd5bce req-7b8d966a-1552-4321-b39a-645b6c6db908 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:11.114213 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-9aa359f9-01a1-4ff0-a413-a0b07cfd5bce req-7b8d966a-1552-4321-b39a-645b6c6db908 service nova] Creating event network-changed:1e23267f-b4be-439b-aa5f-3dbc95900806 for instance e0e4f072-3d61-4169-aba1-decacb716ac7 on hv-cinder-85426 Aug 24 03:57:11.120598 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-9aa359f9-01a1-4ff0-a413-a0b07cfd5bce req-7b8d966a-1552-4321-b39a-645b6c6db908 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046022 Aug 24 03:57:11.121210 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 318/640] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:12.494569 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1baa236a-6c56-4b34-b792-cbdba8cbafa7 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:12.495158 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1baa236a-6c56-4b34-b792-cbdba8cbafa7 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:12.501532 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1baa236a-6c56-4b34-b792-cbdba8cbafa7 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:12.502119 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1baa236a-6c56-4b34-b792-cbdba8cbafa7 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:12.502674 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1baa236a-6c56-4b34-b792-cbdba8cbafa7 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:12.503380 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1baa236a-6c56-4b34-b792-cbdba8cbafa7 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:12.503833 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1baa236a-6c56-4b34-b792-cbdba8cbafa7 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:12.504255 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1baa236a-6c56-4b34-b792-cbdba8cbafa7 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:12.590822 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-1baa236a-6c56-4b34-b792-cbdba8cbafa7 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lazy-loading 'services' on Instance uuid e0e4f072-3d61-4169-aba1-decacb716ac7 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:57:12.846444 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1baa236a-6c56-4b34-b792-cbdba8cbafa7 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "DELETE /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7/os-volume_attachments/d76f6f0f-75a1-4ec7-93f7-c54c0f2e2fb4" status: 202 len: 0 microversion: 2.1 time: 0.357097 Aug 24 03:57:12.847293 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 323/641] 10.222.0.82 () {58 vars in 1416 bytes} [Wed Aug 24 03:57:12 2022] DELETE /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7/os-volume_attachments/d76f6f0f-75a1-4ec7-93f7-c54c0f2e2fb4 => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:57:12.856781 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-438efcfa-4c93-4c75-b503-bd2bb7008cdc tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:12.859329 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-438efcfa-4c93-4c75-b503-bd2bb7008cdc tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:12.865820 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-438efcfa-4c93-4c75-b503-bd2bb7008cdc tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:12.866297 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-438efcfa-4c93-4c75-b503-bd2bb7008cdc tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:12.866782 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-438efcfa-4c93-4c75-b503-bd2bb7008cdc tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:12.867730 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-438efcfa-4c93-4c75-b503-bd2bb7008cdc tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:12.868488 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-438efcfa-4c93-4c75-b503-bd2bb7008cdc tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:12.868913 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-438efcfa-4c93-4c75-b503-bd2bb7008cdc tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:12.900437 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-438efcfa-4c93-4c75-b503-bd2bb7008cdc tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048261 Aug 24 03:57:12.900999 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 319/642] 10.222.0.82 () {58 vars in 1302 bytes} [Wed Aug 24 03:57:12 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:13.137562 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-4b086a9f-3343-428d-a1d9-7a6bc5b2a480 req-3703fc74-f9e6-43d0-bcaa-6c3e554c81f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0e4f072-3d61-4169-aba1-decacb716ac7", "tag": "1e23267f-b4be-439b-aa5f-3dbc95900806"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:13.149141 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-4b086a9f-3343-428d-a1d9-7a6bc5b2a480 req-3703fc74-f9e6-43d0-bcaa-6c3e554c81f0 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:13.149649 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-4b086a9f-3343-428d-a1d9-7a6bc5b2a480 req-3703fc74-f9e6-43d0-bcaa-6c3e554c81f0 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:13.150080 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-4b086a9f-3343-428d-a1d9-7a6bc5b2a480 req-3703fc74-f9e6-43d0-bcaa-6c3e554c81f0 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:13.162114 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-4b086a9f-3343-428d-a1d9-7a6bc5b2a480 req-3703fc74-f9e6-43d0-bcaa-6c3e554c81f0 service nova] Creating event network-changed:1e23267f-b4be-439b-aa5f-3dbc95900806 for instance e0e4f072-3d61-4169-aba1-decacb716ac7 on hv-cinder-85426 Aug 24 03:57:13.167631 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-4b086a9f-3343-428d-a1d9-7a6bc5b2a480 req-3703fc74-f9e6-43d0-bcaa-6c3e554c81f0 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035158 Aug 24 03:57:13.168237 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 324/643] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:13.913386 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-365c8441-4677-49fc-bae5-73779ce8b356 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:13.916528 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-365c8441-4677-49fc-bae5-73779ce8b356 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:13.922898 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-365c8441-4677-49fc-bae5-73779ce8b356 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:13.923393 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-365c8441-4677-49fc-bae5-73779ce8b356 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:13.923827 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-365c8441-4677-49fc-bae5-73779ce8b356 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:13.924527 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-365c8441-4677-49fc-bae5-73779ce8b356 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:13.925019 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-365c8441-4677-49fc-bae5-73779ce8b356 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:13.925404 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-365c8441-4677-49fc-bae5-73779ce8b356 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:13.958415 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-365c8441-4677-49fc-bae5-73779ce8b356 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048794 Aug 24 03:57:13.959158 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 320/644] 10.222.0.82 () {58 vars in 1302 bytes} [Wed Aug 24 03:57:13 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:14.972598 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0034851d-77b0-4cf6-9281-d583441ff524 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:14.975063 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0034851d-77b0-4cf6-9281-d583441ff524 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:14.982464 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0034851d-77b0-4cf6-9281-d583441ff524 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:14.982980 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0034851d-77b0-4cf6-9281-d583441ff524 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:14.983425 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0034851d-77b0-4cf6-9281-d583441ff524 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:14.984124 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0034851d-77b0-4cf6-9281-d583441ff524 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:14.984580 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0034851d-77b0-4cf6-9281-d583441ff524 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:14.985004 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0034851d-77b0-4cf6-9281-d583441ff524 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:15.015710 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0034851d-77b0-4cf6-9281-d583441ff524 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047386 Aug 24 03:57:15.016264 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 325/645] 10.222.0.82 () {58 vars in 1302 bytes} [Wed Aug 24 03:57:14 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:57:15.028834 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-806fbb8a-70f0-43d0-a017-f81b1c101918 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:15.029361 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-806fbb8a-70f0-43d0-a017-f81b1c101918 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:15.036664 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-806fbb8a-70f0-43d0-a017-f81b1c101918 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:15.037146 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-806fbb8a-70f0-43d0-a017-f81b1c101918 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:15.037579 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-806fbb8a-70f0-43d0-a017-f81b1c101918 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:15.038276 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-806fbb8a-70f0-43d0-a017-f81b1c101918 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:15.038791 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-806fbb8a-70f0-43d0-a017-f81b1c101918 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:15.039185 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-806fbb8a-70f0-43d0-a017-f81b1c101918 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:15.113470 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.wsgi [None req-806fbb8a-70f0-43d0-a017-f81b1c101918 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] HTTP exception thrown: Instance e0e4f072-3d61-4169-aba1-decacb716ac7 is not attached to volume d76f6f0f-75a1-4ec7-93f7-c54c0f2e2fb4 Aug 24 03:57:15.115975 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-806fbb8a-70f0-43d0-a017-f81b1c101918 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Request method failure captured: Aug 24 03:57:15.115975 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: request: DELETE /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7/os-volume_attachments/d76f6f0f-75a1-4ec7-93f7-c54c0f2e2fb4 HTTP/1.1 Aug 24 03:57:15.115975 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept: application/json Aug 24 03:57:15.115975 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept-Encoding: identity Aug 24 03:57:15.115975 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Connection: close Aug 24 03:57:15.115975 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Length: 0 Aug 24 03:57:15.115975 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Type: application/json Aug 24 03:57:15.115975 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Host: 10.222.0.82 Aug 24 03:57:15.115975 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Openstack-System-Scope: None Aug 24 03:57:15.115975 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: User-Agent: python-urllib3/1.26.11 Aug 24 03:57:15.115975 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Auth-Token: gAAAAABjBaDjygbZ3vC88lJLJOLR0KRadlf9hLTycI6vE00xQwm_oSZw4qj2PAy5_Pf2AJhn3TqiGhtBdtRAQydpPHLA1u_MGbrfSpZlmLI_69H-M-3MgfaA-vQlWmo4bLpK1crJiqzNcUbEPA0YtF26w85NdrsAwJ8-YqbzekW70wMIluiD29I Aug 24 03:57:15.115975 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Id: None Aug 24 03:57:15.115975 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Name: None Aug 24 03:57:15.115975 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Identity-Status: Confirmed Aug 24 03:57:15.115975 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Is-Admin-Project: True Aug 24 03:57:15.115975 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Id: default Aug 24 03:57:15.115975 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Name: Default Aug 24 03:57:15.115975 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Id: 5d84c2db19c24ef49d5012dd6c28cb7b Aug 24 03:57:15.115975 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Name: tempest-TestMinimumBasicScenario-2119897091 Aug 24 03:57:15.115975 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Role: member,reader Aug 24 03:57:15.115975 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Roles: member,reader Aug 24 03:57:15.117685 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/5d84c2db19c24ef49d5012dd6c28cb7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/5d84c2db19c24ef49d5012dd6c28cb7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/5d84c2db19c24ef49d5012dd6c28cb7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_5d84c2db19c24ef49d5012dd6c28cb7b", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:57:15.117685 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant: tempest-TestMinimumBasicScenario-2119897091 Aug 24 03:57:15.117685 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Id: 5d84c2db19c24ef49d5012dd6c28cb7b Aug 24 03:57:15.117685 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2119897091 Aug 24 03:57:15.117685 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User: tempest-TestMinimumBasicScenario-2119897091-project Aug 24 03:57:15.117685 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Id: default Aug 24 03:57:15.117685 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Name: Default Aug 24 03:57:15.117685 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Id: c662a5d21958400daa83733a93ca4c11 Aug 24 03:57:15.117685 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Name: tempest-TestMinimumBasicScenario-2119897091-project Aug 24 03:57:15.117685 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: method: > Aug 24 03:57:15.117685 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: exception: Instance e0e4f072-3d61-4169-aba1-decacb716ac7 is not attached to volume d76f6f0f-75a1-4ec7-93f7-c54c0f2e2fb4 Aug 24 03:57:15.118619 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: action_args: {'server_id': 'e0e4f072-3d61-4169-aba1-decacb716ac7', 'id': 'd76f6f0f-75a1-4ec7-93f7-c54c0f2e2fb4'} Aug 24 03:57:15.118619 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:57:15.118619 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:15.118619 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 03:57:15.118619 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 03:57:15.118619 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:57:15.118619 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:57:15.118619 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 03:57:15.118619 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 03:57:15.118619 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d76f6f0f-75a1-4ec7-93f7-c54c0f2e2fb4. Aug 24 03:57:15.118619 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:57:15.118619 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:15.118619 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:57:15.118619 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:15.118619 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:15.118619 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:15.118619 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:57:15.118619 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:57:15.118619 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:57:15.120188 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:57:15.120188 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 03:57:15.120188 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 03:57:15.120188 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0e4f072-3d61-4169-aba1-decacb716ac7 is not attached to volume d76f6f0f-75a1-4ec7-93f7-c54c0f2e2fb4 Aug 24 03:57:15.120188 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:57:15.120188 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:15.120188 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:57:15.120188 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:15.120188 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:15.120188 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:15.120188 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:57:15.120188 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:57:15.120188 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0e4f072-3d61-4169-aba1-decacb716ac7 is not attached to volume d76f6f0f-75a1-4ec7-93f7-c54c0f2e2fb4 Aug 24 03:57:15.120188 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:57:15.120188 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-806fbb8a-70f0-43d0-a017-f81b1c101918 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Returning 404 to user: Instance e0e4f072-3d61-4169-aba1-decacb716ac7 is not attached to volume d76f6f0f-75a1-4ec7-93f7-c54c0f2e2fb4 {{(pid=127869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:57:15.121376 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-806fbb8a-70f0-43d0-a017-f81b1c101918 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "DELETE /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7/os-volume_attachments/d76f6f0f-75a1-4ec7-93f7-c54c0f2e2fb4" status: 404 len: 154 microversion: 2.1 time: 0.094819 Aug 24 03:57:15.121376 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 321/646] 10.222.0.82 () {58 vars in 1416 bytes} [Wed Aug 24 03:57:15 2022] DELETE /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7/os-volume_attachments/d76f6f0f-75a1-4ec7-93f7-c54c0f2e2fb4 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:57:15.435018 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-81bb90a8-643f-4848-8d13-7737cc611345 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:15.437600 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-81bb90a8-643f-4848-8d13-7737cc611345 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:15.444227 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81bb90a8-643f-4848-8d13-7737cc611345 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:15.444814 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81bb90a8-643f-4848-8d13-7737cc611345 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:15.445845 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81bb90a8-643f-4848-8d13-7737cc611345 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:15.446579 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81bb90a8-643f-4848-8d13-7737cc611345 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:15.447043 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81bb90a8-643f-4848-8d13-7737cc611345 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:15.447472 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81bb90a8-643f-4848-8d13-7737cc611345 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:15.477056 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-81bb90a8-643f-4848-8d13-7737cc611345 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046636 Aug 24 03:57:15.477619 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 326/647] 10.222.0.82 () {58 vars in 1302 bytes} [Wed Aug 24 03:57:15 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:57:15.540442 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-ca7cf39e-d1a2-4c1e-a2dc-19c92f715225 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:15.540938 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-ca7cf39e-d1a2-4c1e-a2dc-19c92f715225 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:15.546892 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ca7cf39e-d1a2-4c1e-a2dc-19c92f715225 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:15.547382 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ca7cf39e-d1a2-4c1e-a2dc-19c92f715225 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:15.547818 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ca7cf39e-d1a2-4c1e-a2dc-19c92f715225 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:15.548502 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ca7cf39e-d1a2-4c1e-a2dc-19c92f715225 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:15.548953 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ca7cf39e-d1a2-4c1e-a2dc-19c92f715225 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:15.549377 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ca7cf39e-d1a2-4c1e-a2dc-19c92f715225 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:15.575997 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-ca7cf39e-d1a2-4c1e-a2dc-19c92f715225 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Going to try to terminate instance {{(pid=127869) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:57:15.886820 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-ca7cf39e-d1a2-4c1e-a2dc-19c92f715225 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "DELETE /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 204 len: 0 microversion: 2.1 time: 0.350476 Aug 24 03:57:15.887716 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 322/648] 10.222.0.82 () {58 vars in 1239 bytes} [Wed Aug 24 03:57:15 2022] DELETE /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:57:15.895634 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8d951f78-c788-4cc9-9742-5d1fae189831 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:15.896237 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8d951f78-c788-4cc9-9742-5d1fae189831 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:15.902327 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8d951f78-c788-4cc9-9742-5d1fae189831 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:15.902831 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8d951f78-c788-4cc9-9742-5d1fae189831 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:15.903259 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8d951f78-c788-4cc9-9742-5d1fae189831 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:15.903938 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8d951f78-c788-4cc9-9742-5d1fae189831 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:15.904381 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8d951f78-c788-4cc9-9742-5d1fae189831 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:15.904882 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8d951f78-c788-4cc9-9742-5d1fae189831 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:16.040786 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-8d951f78-c788-4cc9-9742-5d1fae189831 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:16.048795 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8d951f78-c788-4cc9-9742-5d1fae189831 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1672 microversion: 2.1 time: 0.156976 Aug 24 03:57:16.049373 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 327/649] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:15 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:16.418424 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-9cdb4c75-441f-4e2e-ba3c-830b39f6d974 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:16.419040 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-9cdb4c75-441f-4e2e-ba3c-830b39f6d974 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:16.425385 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9cdb4c75-441f-4e2e-ba3c-830b39f6d974 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:16.425856 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9cdb4c75-441f-4e2e-ba3c-830b39f6d974 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:16.426310 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9cdb4c75-441f-4e2e-ba3c-830b39f6d974 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:16.427020 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9cdb4c75-441f-4e2e-ba3c-830b39f6d974 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:16.427468 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9cdb4c75-441f-4e2e-ba3c-830b39f6d974 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:16.427887 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9cdb4c75-441f-4e2e-ba3c-830b39f6d974 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:16.452946 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-9cdb4c75-441f-4e2e-ba3c-830b39f6d974 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Going to try to terminate instance {{(pid=127869) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:57:16.743775 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-9cdb4c75-441f-4e2e-ba3c-830b39f6d974 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "DELETE /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 204 len: 0 microversion: 2.1 time: 0.329743 Aug 24 03:57:16.744359 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 323/650] 10.222.0.82 () {58 vars in 1239 bytes} [Wed Aug 24 03:57:16 2022] DELETE /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:57:16.752478 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-659b10df-1f7a-46b9-812a-001017aef4dd tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:16.753081 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-659b10df-1f7a-46b9-812a-001017aef4dd tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:16.759912 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-659b10df-1f7a-46b9-812a-001017aef4dd tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:16.760386 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-659b10df-1f7a-46b9-812a-001017aef4dd tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:16.760814 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-659b10df-1f7a-46b9-812a-001017aef4dd tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:16.761486 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-659b10df-1f7a-46b9-812a-001017aef4dd tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:16.761958 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-659b10df-1f7a-46b9-812a-001017aef4dd tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:16.762381 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-659b10df-1f7a-46b9-812a-001017aef4dd tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:16.893519 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-659b10df-1f7a-46b9-812a-001017aef4dd tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:16.901454 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-659b10df-1f7a-46b9-812a-001017aef4dd tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1554 microversion: 2.1 time: 0.152794 Aug 24 03:57:16.902018 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 328/651] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:16 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:17.072158 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-005d3d58-c5a5-4882-bdd2-89300d8bd149 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:17.072853 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-005d3d58-c5a5-4882-bdd2-89300d8bd149 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:17.078947 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-005d3d58-c5a5-4882-bdd2-89300d8bd149 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:17.079435 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-005d3d58-c5a5-4882-bdd2-89300d8bd149 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:17.079872 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-005d3d58-c5a5-4882-bdd2-89300d8bd149 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:17.080564 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-005d3d58-c5a5-4882-bdd2-89300d8bd149 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:17.081015 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-005d3d58-c5a5-4882-bdd2-89300d8bd149 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:17.081435 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-005d3d58-c5a5-4882-bdd2-89300d8bd149 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:17.215534 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-005d3d58-c5a5-4882-bdd2-89300d8bd149 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:17.223262 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-005d3d58-c5a5-4882-bdd2-89300d8bd149 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1672 microversion: 2.1 time: 0.156319 Aug 24 03:57:17.223830 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 324/652] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:17 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:17.922409 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b9751ba0-fab2-4840-ac7b-63ab0a6a7c41 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:17.923068 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b9751ba0-fab2-4840-ac7b-63ab0a6a7c41 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:17.929725 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b9751ba0-fab2-4840-ac7b-63ab0a6a7c41 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:17.930198 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b9751ba0-fab2-4840-ac7b-63ab0a6a7c41 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:17.930658 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b9751ba0-fab2-4840-ac7b-63ab0a6a7c41 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:17.931334 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b9751ba0-fab2-4840-ac7b-63ab0a6a7c41 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:17.931779 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b9751ba0-fab2-4840-ac7b-63ab0a6a7c41 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:17.932192 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b9751ba0-fab2-4840-ac7b-63ab0a6a7c41 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:18.063951 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-b9751ba0-fab2-4840-ac7b-63ab0a6a7c41 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:18.072280 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b9751ba0-fab2-4840-ac7b-63ab0a6a7c41 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1554 microversion: 2.1 time: 0.153770 Aug 24 03:57:18.072842 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 329/653] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:17 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:18.244420 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-c6c37a63-d4d8-4c3b-9453-3f12838ef546 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:18.244962 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-c6c37a63-d4d8-4c3b-9453-3f12838ef546 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:18.251337 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c6c37a63-d4d8-4c3b-9453-3f12838ef546 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:18.251809 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c6c37a63-d4d8-4c3b-9453-3f12838ef546 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:18.252231 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c6c37a63-d4d8-4c3b-9453-3f12838ef546 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:18.252902 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c6c37a63-d4d8-4c3b-9453-3f12838ef546 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:18.253347 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c6c37a63-d4d8-4c3b-9453-3f12838ef546 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:18.253755 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c6c37a63-d4d8-4c3b-9453-3f12838ef546 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:18.394081 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-c6c37a63-d4d8-4c3b-9453-3f12838ef546 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:18.402104 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-c6c37a63-d4d8-4c3b-9453-3f12838ef546 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1672 microversion: 2.1 time: 0.161659 Aug 24 03:57:18.402688 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 325/654] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:18 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1672 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:19.101319 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-58da9fdc-3795-4190-ac56-acad25cebaa2 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:19.101931 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-58da9fdc-3795-4190-ac56-acad25cebaa2 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:19.108431 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-58da9fdc-3795-4190-ac56-acad25cebaa2 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:19.108902 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-58da9fdc-3795-4190-ac56-acad25cebaa2 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:19.109335 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-58da9fdc-3795-4190-ac56-acad25cebaa2 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:19.110016 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-58da9fdc-3795-4190-ac56-acad25cebaa2 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:19.110462 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-58da9fdc-3795-4190-ac56-acad25cebaa2 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:19.110933 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-58da9fdc-3795-4190-ac56-acad25cebaa2 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:19.129503 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:19.240489 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-58da9fdc-3795-4190-ac56-acad25cebaa2 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:19.248209 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-58da9fdc-3795-4190-ac56-acad25cebaa2 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1554 microversion: 2.1 time: 0.151301 Aug 24 03:57:19.248777 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 330/655] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:19 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:19.423326 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-a55a0591-9c01-4313-abe5-54fbf3e38e66 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:19.423966 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-a55a0591-9c01-4313-abe5-54fbf3e38e66 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:19.430281 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a55a0591-9c01-4313-abe5-54fbf3e38e66 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:19.430782 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a55a0591-9c01-4313-abe5-54fbf3e38e66 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:19.431214 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a55a0591-9c01-4313-abe5-54fbf3e38e66 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:19.431886 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a55a0591-9c01-4313-abe5-54fbf3e38e66 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:19.432332 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a55a0591-9c01-4313-abe5-54fbf3e38e66 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:19.432748 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a55a0591-9c01-4313-abe5-54fbf3e38e66 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:19.566108 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-a55a0591-9c01-4313-abe5-54fbf3e38e66 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:19.574196 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-a55a0591-9c01-4313-abe5-54fbf3e38e66 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1672 microversion: 2.1 time: 0.154685 Aug 24 03:57:19.574867 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 326/656] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:19 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:20.268945 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b45bd49c-7486-4bed-a79b-9d372b7bb793 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:20.269546 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b45bd49c-7486-4bed-a79b-9d372b7bb793 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:20.276031 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b45bd49c-7486-4bed-a79b-9d372b7bb793 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:20.276452 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b45bd49c-7486-4bed-a79b-9d372b7bb793 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:20.276883 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b45bd49c-7486-4bed-a79b-9d372b7bb793 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:20.277559 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b45bd49c-7486-4bed-a79b-9d372b7bb793 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:20.278004 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b45bd49c-7486-4bed-a79b-9d372b7bb793 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:20.278418 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b45bd49c-7486-4bed-a79b-9d372b7bb793 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:20.450700 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-b45bd49c-7486-4bed-a79b-9d372b7bb793 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:20.460000 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b45bd49c-7486-4bed-a79b-9d372b7bb793 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1554 microversion: 2.1 time: 0.194705 Aug 24 03:57:20.466820 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 331/657] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:20 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1554 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:20.595660 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-02abd8b8-e7f1-4e3e-a104-c1e0af278061 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:20.596320 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-02abd8b8-e7f1-4e3e-a104-c1e0af278061 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:20.603407 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-02abd8b8-e7f1-4e3e-a104-c1e0af278061 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:20.604412 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-02abd8b8-e7f1-4e3e-a104-c1e0af278061 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:20.604412 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-02abd8b8-e7f1-4e3e-a104-c1e0af278061 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:20.604973 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-02abd8b8-e7f1-4e3e-a104-c1e0af278061 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:20.605415 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-02abd8b8-e7f1-4e3e-a104-c1e0af278061 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:20.605837 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-02abd8b8-e7f1-4e3e-a104-c1e0af278061 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:21.008227 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-8585bb48-5e06-4f63-b66a-25e7238cfb24 req-57da5026-4971-4d27-a0b2-51f4ce80f765 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0e4f072-3d61-4169-aba1-decacb716ac7", "name": "network-vif-deleted", "tag": "1e23267f-b4be-439b-aa5f-3dbc95900806"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:21.018977 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-8585bb48-5e06-4f63-b66a-25e7238cfb24 req-57da5026-4971-4d27-a0b2-51f4ce80f765 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:21.019580 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-8585bb48-5e06-4f63-b66a-25e7238cfb24 req-57da5026-4971-4d27-a0b2-51f4ce80f765 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:21.020012 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-8585bb48-5e06-4f63-b66a-25e7238cfb24 req-57da5026-4971-4d27-a0b2-51f4ce80f765 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:21.033096 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-8585bb48-5e06-4f63-b66a-25e7238cfb24 req-57da5026-4971-4d27-a0b2-51f4ce80f765 service nova] Creating event network-vif-deleted:1e23267f-b4be-439b-aa5f-3dbc95900806 for instance e0e4f072-3d61-4169-aba1-decacb716ac7 on hv-cinder-85426 Aug 24 03:57:21.038185 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-8585bb48-5e06-4f63-b66a-25e7238cfb24 req-57da5026-4971-4d27-a0b2-51f4ce80f765 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034468 Aug 24 03:57:21.039766 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 332/658] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:21.100386 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-02abd8b8-e7f1-4e3e-a104-c1e0af278061 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:21.110147 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-02abd8b8-e7f1-4e3e-a104-c1e0af278061 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1672 microversion: 2.1 time: 0.518253 Aug 24 03:57:21.123253 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 327/659] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:20 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1672 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:21.482532 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-32868633-b549-41e7-93b7-2826f5c49590 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:21.483244 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-32868633-b549-41e7-93b7-2826f5c49590 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:21.489535 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-32868633-b549-41e7-93b7-2826f5c49590 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:21.490096 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-32868633-b549-41e7-93b7-2826f5c49590 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:21.490556 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-32868633-b549-41e7-93b7-2826f5c49590 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:21.491801 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-32868633-b549-41e7-93b7-2826f5c49590 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:21.492340 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-32868633-b549-41e7-93b7-2826f5c49590 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:21.492851 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-32868633-b549-41e7-93b7-2826f5c49590 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:21.525860 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-32868633-b549-41e7-93b7-2826f5c49590 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:21.526370 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-32868633-b549-41e7-93b7-2826f5c49590 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:21.526837 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-32868633-b549-41e7-93b7-2826f5c49590 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:21.527361 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-32868633-b549-41e7-93b7-2826f5c49590 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lazy-loading 'fault' on Instance uuid e0e4f072-3d61-4169-aba1-decacb716ac7 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:57:21.575095 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-32868633-b549-41e7-93b7-2826f5c49590 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c662a5d21958400daa83733a93ca4c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d84c2db19c24ef49d5012dd6c28cb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:21.590899 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-32868633-b549-41e7-93b7-2826f5c49590 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 200 len: 1348 microversion: 2.1 time: 0.113051 Aug 24 03:57:21.593074 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 333/660] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:21 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 1348 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:21.627238 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-fa9f0379-7735-4687-84da-ffd2fb25dc33 req-36bf9978-d426-420b-9940-6dbb54fea209 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aa2d996-08d6-46ce-b978-5de69b34a0f6", "name": "network-vif-deleted", "tag": "857c15de-4f2d-494e-a54d-e21ae0588263"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:21.636973 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-fa9f0379-7735-4687-84da-ffd2fb25dc33 req-36bf9978-d426-420b-9940-6dbb54fea209 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:21.637450 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-fa9f0379-7735-4687-84da-ffd2fb25dc33 req-36bf9978-d426-420b-9940-6dbb54fea209 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:21.637876 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-fa9f0379-7735-4687-84da-ffd2fb25dc33 req-36bf9978-d426-420b-9940-6dbb54fea209 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:21.641618 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:21.649147 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-fa9f0379-7735-4687-84da-ffd2fb25dc33 req-36bf9978-d426-420b-9940-6dbb54fea209 service nova] Creating event network-vif-deleted:857c15de-4f2d-494e-a54d-e21ae0588263 for instance 0aa2d996-08d6-46ce-b978-5de69b34a0f6 on hv-cinder-85426 Aug 24 03:57:21.655808 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-fa9f0379-7735-4687-84da-ffd2fb25dc33 req-36bf9978-d426-420b-9940-6dbb54fea209 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032297 Aug 24 03:57:21.656389 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 328/661] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:22.256445 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e5a79524-7eb4-40a1-9161-3f85d9465e82 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:22.257555 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e5a79524-7eb4-40a1-9161-3f85d9465e82 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:22.263536 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e5a79524-7eb4-40a1-9161-3f85d9465e82 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:22.282872 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e5a79524-7eb4-40a1-9161-3f85d9465e82 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:22.282872 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e5a79524-7eb4-40a1-9161-3f85d9465e82 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:22.282872 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e5a79524-7eb4-40a1-9161-3f85d9465e82 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:22.282872 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e5a79524-7eb4-40a1-9161-3f85d9465e82 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:22.283421 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e5a79524-7eb4-40a1-9161-3f85d9465e82 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:22.300299 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e5a79524-7eb4-40a1-9161-3f85d9465e82 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:22.300775 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e5a79524-7eb4-40a1-9161-3f85d9465e82 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:22.301311 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e5a79524-7eb4-40a1-9161-3f85d9465e82 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:22.301642 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-e5a79524-7eb4-40a1-9161-3f85d9465e82 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lazy-loading 'fault' on Instance uuid 0aa2d996-08d6-46ce-b978-5de69b34a0f6 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:57:22.344997 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-e5a79524-7eb4-40a1-9161-3f85d9465e82 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:22.353780 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e5a79524-7eb4-40a1-9161-3f85d9465e82 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 200 len: 1326 microversion: 2.1 time: 0.224424 Aug 24 03:57:22.354380 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 334/662] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:22 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 1326 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:22.448307 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:57:22.448497 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Wed Aug 24 03:57:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:57:22.613681 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-5bbd6146-4dd4-49f6-93ef-6907d167a616 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:22.614380 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-5bbd6146-4dd4-49f6-93ef-6907d167a616 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] [instance: e0e4f072-3d61-4169-aba1-decacb716ac7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:22.621620 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5bbd6146-4dd4-49f6-93ef-6907d167a616 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:22.622109 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5bbd6146-4dd4-49f6-93ef-6907d167a616 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:22.622573 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5bbd6146-4dd4-49f6-93ef-6907d167a616 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:22.623279 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5bbd6146-4dd4-49f6-93ef-6907d167a616 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:22.623731 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5bbd6146-4dd4-49f6-93ef-6907d167a616 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:22.624157 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5bbd6146-4dd4-49f6-93ef-6907d167a616 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:22.640153 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.wsgi [None req-5bbd6146-4dd4-49f6-93ef-6907d167a616 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] HTTP exception thrown: Instance e0e4f072-3d61-4169-aba1-decacb716ac7 could not be found. Aug 24 03:57:22.641795 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-5bbd6146-4dd4-49f6-93ef-6907d167a616 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Request method failure captured: Aug 24 03:57:22.641795 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: request: GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 HTTP/1.1 Aug 24 03:57:22.641795 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept: application/json Aug 24 03:57:22.641795 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept-Encoding: identity Aug 24 03:57:22.641795 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Connection: close Aug 24 03:57:22.641795 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Length: 0 Aug 24 03:57:22.641795 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Type: application/json Aug 24 03:57:22.641795 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Host: 10.222.0.82 Aug 24 03:57:22.641795 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Openstack-System-Scope: None Aug 24 03:57:22.641795 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: User-Agent: python-urllib3/1.26.11 Aug 24 03:57:22.641795 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Auth-Token: gAAAAABjBaDjygbZ3vC88lJLJOLR0KRadlf9hLTycI6vE00xQwm_oSZw4qj2PAy5_Pf2AJhn3TqiGhtBdtRAQydpPHLA1u_MGbrfSpZlmLI_69H-M-3MgfaA-vQlWmo4bLpK1crJiqzNcUbEPA0YtF26w85NdrsAwJ8-YqbzekW70wMIluiD29I Aug 24 03:57:22.641795 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Id: None Aug 24 03:57:22.641795 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Name: None Aug 24 03:57:22.641795 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Identity-Status: Confirmed Aug 24 03:57:22.641795 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Is-Admin-Project: True Aug 24 03:57:22.641795 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Id: default Aug 24 03:57:22.641795 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Name: Default Aug 24 03:57:22.641795 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Id: 5d84c2db19c24ef49d5012dd6c28cb7b Aug 24 03:57:22.641795 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Name: tempest-TestMinimumBasicScenario-2119897091 Aug 24 03:57:22.641795 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Role: member,reader Aug 24 03:57:22.641795 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Roles: member,reader Aug 24 03:57:22.643371 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/5d84c2db19c24ef49d5012dd6c28cb7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/5d84c2db19c24ef49d5012dd6c28cb7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/5d84c2db19c24ef49d5012dd6c28cb7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_5d84c2db19c24ef49d5012dd6c28cb7b", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:57:22.643371 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant: tempest-TestMinimumBasicScenario-2119897091 Aug 24 03:57:22.643371 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Id: 5d84c2db19c24ef49d5012dd6c28cb7b Aug 24 03:57:22.643371 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2119897091 Aug 24 03:57:22.643371 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User: tempest-TestMinimumBasicScenario-2119897091-project Aug 24 03:57:22.643371 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Id: default Aug 24 03:57:22.643371 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Name: Default Aug 24 03:57:22.643371 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Id: c662a5d21958400daa83733a93ca4c11 Aug 24 03:57:22.643371 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Name: tempest-TestMinimumBasicScenario-2119897091-project Aug 24 03:57:22.643371 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: method: > Aug 24 03:57:22.643371 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: exception: Instance e0e4f072-3d61-4169-aba1-decacb716ac7 could not be found. Aug 24 03:57:22.643371 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: action_args: {'id': 'e0e4f072-3d61-4169-aba1-decacb716ac7'} Aug 24 03:57:22.644107 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:57:22.644107 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:22.644107 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:57:22.644107 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:57:22.644107 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:57:22.644107 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:57:22.644107 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:57:22.644107 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:57:22.644107 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:57:22.644107 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:57:22.644107 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0e4f072-3d61-4169-aba1-decacb716ac7 could not be found. Aug 24 03:57:22.644107 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:57:22.644107 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:22.644107 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:57:22.644107 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:22.644107 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:22.644107 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:22.644107 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:57:22.644107 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:57:22.644107 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:57:22.645289 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:57:22.645289 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:57:22.645289 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:57:22.645289 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:57:22.645289 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:57:22.645289 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:57:22.645289 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:57:22.645289 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0e4f072-3d61-4169-aba1-decacb716ac7 could not be found. Aug 24 03:57:22.645289 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:57:22.645289 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:22.645289 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:57:22.645289 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:22.645289 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:22.645289 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:22.645289 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:57:22.645289 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:57:22.645289 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0e4f072-3d61-4169-aba1-decacb716ac7 could not be found. Aug 24 03:57:22.645289 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:57:22.647649 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-5bbd6146-4dd4-49f6-93ef-6907d167a616 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Returning 404 to user: Instance e0e4f072-3d61-4169-aba1-decacb716ac7 could not be found. {{(pid=127869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:57:22.647649 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-5bbd6146-4dd4-49f6-93ef-6907d167a616 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7" status: 404 len: 111 microversion: 2.1 time: 0.034253 Aug 24 03:57:22.647649 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 329/663] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:22 2022] GET /compute/v2.1/servers/e0e4f072-3d61-4169-aba1-decacb716ac7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:57:22.652455 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-614d60c3-851d-49c5-b878-c90dc25378a2 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] Calling method '.version_select at 0x7f1547fd8940>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:22.756968 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-614d60c3-851d-49c5-b878-c90dc25378a2 tempest-TestMinimumBasicScenario-2119897091 tempest-TestMinimumBasicScenario-2119897091-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1388918039" status: 202 len: 0 microversion: 2.1 time: 0.108042 Aug 24 03:57:22.757728 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 335/664] 10.222.0.82 () {58 vars in 1272 bytes} [Wed Aug 24 03:57:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1388918039 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:57:23.379415 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-251f05ed-3018-41dd-a2d4-47b17bb5fa2d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:23.380022 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-251f05ed-3018-41dd-a2d4-47b17bb5fa2d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:23.387160 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-251f05ed-3018-41dd-a2d4-47b17bb5fa2d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:23.387580 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-251f05ed-3018-41dd-a2d4-47b17bb5fa2d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:23.388011 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-251f05ed-3018-41dd-a2d4-47b17bb5fa2d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:23.388694 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-251f05ed-3018-41dd-a2d4-47b17bb5fa2d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:23.389141 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-251f05ed-3018-41dd-a2d4-47b17bb5fa2d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:23.389559 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-251f05ed-3018-41dd-a2d4-47b17bb5fa2d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:23.403259 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.wsgi [None req-251f05ed-3018-41dd-a2d4-47b17bb5fa2d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] HTTP exception thrown: Instance 0aa2d996-08d6-46ce-b978-5de69b34a0f6 could not be found. Aug 24 03:57:23.404810 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-251f05ed-3018-41dd-a2d4-47b17bb5fa2d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Request method failure captured: Aug 24 03:57:23.404810 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: request: GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 HTTP/1.1 Aug 24 03:57:23.404810 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept: application/json Aug 24 03:57:23.404810 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept-Encoding: identity Aug 24 03:57:23.404810 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Connection: close Aug 24 03:57:23.404810 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Length: 0 Aug 24 03:57:23.404810 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Type: application/json Aug 24 03:57:23.404810 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Host: 10.222.0.82 Aug 24 03:57:23.404810 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Openstack-System-Scope: None Aug 24 03:57:23.404810 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: User-Agent: python-urllib3/1.26.11 Aug 24 03:57:23.404810 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Auth-Token: gAAAAABjBaB1cjCRnkMdHT63ADEXIl04mKhwJKM8oB9_h50wLjevdzc0b0dxIWZS5wG2Ps-xU1gmr2cQNGh_Jy8xgNCbrBWwOVouw_UcERGGMkxy0MkStgJZtLDlrU4C8PdZSSvTSNljq4C40rGVOwds8ysCUWQ6A06SBL2ZgzFe5zxFM_wEzTc Aug 24 03:57:23.404810 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Id: None Aug 24 03:57:23.404810 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Name: None Aug 24 03:57:23.404810 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Identity-Status: Confirmed Aug 24 03:57:23.404810 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Is-Admin-Project: True Aug 24 03:57:23.404810 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Id: default Aug 24 03:57:23.404810 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Name: Default Aug 24 03:57:23.404810 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Id: bdb802f52e1140d488ff0c6d739cd0d1 Aug 24 03:57:23.404810 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Name: tempest-AttachVolumeTestJSON-642371474 Aug 24 03:57:23.404810 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Role: member,reader Aug 24 03:57:23.404810 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Roles: member,reader Aug 24 03:57:23.407474 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/bdb802f52e1140d488ff0c6d739cd0d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/bdb802f52e1140d488ff0c6d739cd0d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/bdb802f52e1140d488ff0c6d739cd0d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_bdb802f52e1140d488ff0c6d739cd0d1", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:57:23.407474 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant: tempest-AttachVolumeTestJSON-642371474 Aug 24 03:57:23.407474 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Id: bdb802f52e1140d488ff0c6d739cd0d1 Aug 24 03:57:23.407474 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Name: tempest-AttachVolumeTestJSON-642371474 Aug 24 03:57:23.407474 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User: tempest-AttachVolumeTestJSON-642371474-project Aug 24 03:57:23.407474 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Id: default Aug 24 03:57:23.407474 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Name: Default Aug 24 03:57:23.407474 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Id: c7e29563153a4ecbbe7447bed0324df7 Aug 24 03:57:23.407474 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Name: tempest-AttachVolumeTestJSON-642371474-project Aug 24 03:57:23.407474 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: method: > Aug 24 03:57:23.407474 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: exception: Instance 0aa2d996-08d6-46ce-b978-5de69b34a0f6 could not be found. Aug 24 03:57:23.407474 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: action_args: {'id': '0aa2d996-08d6-46ce-b978-5de69b34a0f6'} Aug 24 03:57:23.408258 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:57:23.408258 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:23.408258 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:57:23.408258 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:57:23.408258 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:57:23.408258 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:57:23.408258 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:57:23.408258 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:57:23.408258 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:57:23.408258 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:57:23.408258 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0aa2d996-08d6-46ce-b978-5de69b34a0f6 could not be found. Aug 24 03:57:23.408258 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:57:23.408258 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:23.408258 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:57:23.408258 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:23.408258 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:23.408258 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:23.408258 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:57:23.408258 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:57:23.408258 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:57:23.409438 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:57:23.409438 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:57:23.409438 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:57:23.409438 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:57:23.409438 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:57:23.409438 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:57:23.409438 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:57:23.409438 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0aa2d996-08d6-46ce-b978-5de69b34a0f6 could not be found. Aug 24 03:57:23.409438 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:57:23.409438 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:23.409438 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:57:23.409438 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:23.409438 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:23.409438 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:23.409438 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:57:23.409438 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:57:23.409438 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0aa2d996-08d6-46ce-b978-5de69b34a0f6 could not be found. Aug 24 03:57:23.409438 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:57:23.410475 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-251f05ed-3018-41dd-a2d4-47b17bb5fa2d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Returning 404 to user: Instance 0aa2d996-08d6-46ce-b978-5de69b34a0f6 could not be found. {{(pid=127869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:57:23.410475 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-251f05ed-3018-41dd-a2d4-47b17bb5fa2d tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 404 len: 111 microversion: 2.1 time: 0.031039 Aug 24 03:57:23.410475 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 330/665] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:23 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:57:23.416486 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-35026546-8fd9-4bde-9996-bf1d8dc6a244 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '.version_select at 0x7f1547fa1d30>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:23.500314 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-35026546-8fd9-4bde-9996-bf1d8dc6a244 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-759759468" status: 202 len: 0 microversion: 2.1 time: 0.088656 Aug 24 03:57:23.500953 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 336/666] 10.222.0.82 () {58 vars in 1218 bytes} [Wed Aug 24 03:57:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-759759468 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:57:24.282394 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-db0c45a3-a546-474e-a710-6aafbff4e357 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Action: 'create', calling method: .version_select at 0x7f15542a2c10>, body: {"keypair": {"name": "tempest-keypair-1091142487", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEANgWMCc4PZI4iy+xZk5WpJ9YIpY2oQgAf7ScrJ8aYdCj0CC60WAcdpbH4ajZKaAyv3KRzYogrMXVZeZH+G/clHziTNANadyn0yBtRjJldshCHiPA+T+UXEj0jL3lFkw=="}} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:24.301332 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.quota [None req-db0c45a3-a546-474e-a710-6aafbff4e357 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Getting quotas for project bdb802f52e1140d488ff0c6d739cd0d1. Resources: {'key_pairs'} {{(pid=127869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:57:24.305217 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.quota [None req-db0c45a3-a546-474e-a710-6aafbff4e357 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Getting quotas for user c7e29563153a4ecbbe7447bed0324df7 and project bdb802f52e1140d488ff0c6d739cd0d1. Resources: {'key_pairs'} {{(pid=127869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:57:24.396204 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-db0c45a3-a546-474e-a710-6aafbff4e357 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.117732 Aug 24 03:57:24.396800 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 331/667] 10.222.0.82 () {60 vars in 1159 bytes} [Wed Aug 24 03:57:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:26.709260 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ebf23c8e-c8f2-4bfd-a111-2fe04bc09b4f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-163196307", "imageRef": "c32522f7-22a8-45d4-a51e-f17637def2e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "79c88d18-c776-4788-a1a0-0200042ca791"}], "security_groups": [{"name": "tempest-securitygroup--2145193869"}], "key_name": "tempest-keypair-1091142487", "user_data": "}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:26.825887 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-ebf23c8e-c8f2-4bfd-a111-2fe04bc09b4f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] validate_networks() for [('79c88d18-c776-4788-a1a0-0200042ca791', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:57:27.623773 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-ebf23c8e-c8f2-4bfd-a111-2fe04bc09b4f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:57:27.624191 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-ebf23c8e-c8f2-4bfd-a111-2fe04bc09b4f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:57:27.624780 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-ebf23c8e-c8f2-4bfd-a111-2fe04bc09b4f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:57:27.625216 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-ebf23c8e-c8f2-4bfd-a111-2fe04bc09b4f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:57:27.625621 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-ebf23c8e-c8f2-4bfd-a111-2fe04bc09b4f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:57:27.634726 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ebf23c8e-c8f2-4bfd-a111-2fe04bc09b4f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:27.635191 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ebf23c8e-c8f2-4bfd-a111-2fe04bc09b4f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:27.635619 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ebf23c8e-c8f2-4bfd-a111-2fe04bc09b4f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:27.636329 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ebf23c8e-c8f2-4bfd-a111-2fe04bc09b4f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:27.636774 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ebf23c8e-c8f2-4bfd-a111-2fe04bc09b4f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:27.637187 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ebf23c8e-c8f2-4bfd-a111-2fe04bc09b4f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:27.653877 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.quota [None req-ebf23c8e-c8f2-4bfd-a111-2fe04bc09b4f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Getting quotas for project bdb802f52e1140d488ff0c6d739cd0d1. Resources: {'instances', 'cores', 'ram'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:57:27.658095 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.quota [None req-ebf23c8e-c8f2-4bfd-a111-2fe04bc09b4f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Getting quotas for user c7e29563153a4ecbbe7447bed0324df7 and project bdb802f52e1140d488ff0c6d739cd0d1. Resources: {'instances', 'cores', 'ram'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:57:27.669638 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ebf23c8e-c8f2-4bfd-a111-2fe04bc09b4f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:57:27.671892 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ebf23c8e-c8f2-4bfd-a111-2fe04bc09b4f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: a362c623-fa9a-4da0-b8f5-64233f2651ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c32522f7-22a8-45d4-a51e-f17637def2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:57:27.820157 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ebf23c8e-c8f2-4bfd-a111-2fe04bc09b4f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.115829 Aug 24 03:57:27.820890 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 337/668] 10.222.0.82 () {60 vars in 1147 bytes} [Wed Aug 24 03:57:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 1117 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:57:27.838676 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-9f6e08c6-1c5e-4807-908e-a5a781df8385 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:27.843161 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-9f6e08c6-1c5e-4807-908e-a5a781df8385 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: a362c623-fa9a-4da0-b8f5-64233f2651ba] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:27.848244 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:27.920251 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-9f6e08c6-1c5e-4807-908e-a5a781df8385 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:27.929021 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-9f6e08c6-1c5e-4807-908e-a5a781df8385 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba" status: 200 len: 1237 microversion: 2.1 time: 0.099641 Aug 24 03:57:27.930969 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 332/669] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:27 2022] GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba => generated 1237 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:28.951474 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fd1081a3-d5c7-402c-a717-a742624f200e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:28.952067 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fd1081a3-d5c7-402c-a717-a742624f200e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: a362c623-fa9a-4da0-b8f5-64233f2651ba] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:29.012419 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-fd1081a3-d5c7-402c-a717-a742624f200e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:29.024420 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fd1081a3-d5c7-402c-a717-a742624f200e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba" status: 200 len: 1237 microversion: 2.1 time: 0.077098 Aug 24 03:57:29.025000 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 338/670] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:28 2022] GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba => generated 1237 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:30.045053 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-8456baf9-7c78-4cc2-9024-de38f01d496c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:30.045658 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-8456baf9-7c78-4cc2-9024-de38f01d496c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: a362c623-fa9a-4da0-b8f5-64233f2651ba] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:30.052506 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8456baf9-7c78-4cc2-9024-de38f01d496c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:30.053618 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8456baf9-7c78-4cc2-9024-de38f01d496c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:30.054131 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8456baf9-7c78-4cc2-9024-de38f01d496c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:30.054764 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8456baf9-7c78-4cc2-9024-de38f01d496c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:30.055243 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8456baf9-7c78-4cc2-9024-de38f01d496c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:30.055659 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8456baf9-7c78-4cc2-9024-de38f01d496c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:30.128777 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-8456baf9-7c78-4cc2-9024-de38f01d496c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:30.136931 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-8456baf9-7c78-4cc2-9024-de38f01d496c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba" status: 200 len: 1289 microversion: 2.1 time: 0.095720 Aug 24 03:57:30.137497 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 333/671] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:30 2022] GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba => generated 1289 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:31.159113 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5626279f-2ec9-4d05-ab90-a8a1710af242 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:31.159735 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5626279f-2ec9-4d05-ab90-a8a1710af242 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: a362c623-fa9a-4da0-b8f5-64233f2651ba] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:31.166835 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5626279f-2ec9-4d05-ab90-a8a1710af242 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:31.167318 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5626279f-2ec9-4d05-ab90-a8a1710af242 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:31.167749 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5626279f-2ec9-4d05-ab90-a8a1710af242 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:31.168446 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5626279f-2ec9-4d05-ab90-a8a1710af242 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:31.168893 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5626279f-2ec9-4d05-ab90-a8a1710af242 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:31.169312 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5626279f-2ec9-4d05-ab90-a8a1710af242 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:31.236855 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-5626279f-2ec9-4d05-ab90-a8a1710af242 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:31.245944 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5626279f-2ec9-4d05-ab90-a8a1710af242 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba" status: 200 len: 1295 microversion: 2.1 time: 0.090723 Aug 24 03:57:31.246543 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 339/672] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:31 2022] GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba => generated 1295 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:32.273440 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-be405d52-dd26-49da-937c-da55d6f7c2a0 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:32.296974 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-be405d52-dd26-49da-937c-da55d6f7c2a0 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: a362c623-fa9a-4da0-b8f5-64233f2651ba] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:32.296974 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-be405d52-dd26-49da-937c-da55d6f7c2a0 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:32.296974 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-be405d52-dd26-49da-937c-da55d6f7c2a0 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:32.296974 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-be405d52-dd26-49da-937c-da55d6f7c2a0 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:32.298647 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-be405d52-dd26-49da-937c-da55d6f7c2a0 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:32.298647 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-be405d52-dd26-49da-937c-da55d6f7c2a0 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:32.298647 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-be405d52-dd26-49da-937c-da55d6f7c2a0 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:32.593056 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-be405d52-dd26-49da-937c-da55d6f7c2a0 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:32.597118 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-be405d52-dd26-49da-937c-da55d6f7c2a0 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba" status: 200 len: 1363 microversion: 2.1 time: 0.328075 Aug 24 03:57:32.597898 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 334/673] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:32 2022] GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba => generated 1363 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:33.165244 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-2382b0b5-c807-4547-9a73-ae8d84ea1c3e req-0e1f032e-65d4-42e2-9229-6f573e86ddb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a362c623-fa9a-4da0-b8f5-64233f2651ba", "tag": "f8530983-e556-4b26-9386-08d90e5ab898"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:33.181620 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-2382b0b5-c807-4547-9a73-ae8d84ea1c3e req-0e1f032e-65d4-42e2-9229-6f573e86ddb4 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:33.183312 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-2382b0b5-c807-4547-9a73-ae8d84ea1c3e req-0e1f032e-65d4-42e2-9229-6f573e86ddb4 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:33.183312 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-2382b0b5-c807-4547-9a73-ae8d84ea1c3e req-0e1f032e-65d4-42e2-9229-6f573e86ddb4 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:33.194696 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-2382b0b5-c807-4547-9a73-ae8d84ea1c3e req-0e1f032e-65d4-42e2-9229-6f573e86ddb4 service nova] Creating event network-changed:f8530983-e556-4b26-9386-08d90e5ab898 for instance a362c623-fa9a-4da0-b8f5-64233f2651ba on hv-cinder-85426 Aug 24 03:57:33.201073 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-2382b0b5-c807-4547-9a73-ae8d84ea1c3e req-0e1f032e-65d4-42e2-9229-6f573e86ddb4 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041780 Aug 24 03:57:33.202210 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 340/674] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:33.620089 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-f207ab44-ef62-48c1-9c0d-beef202e00ec tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:33.624915 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-f207ab44-ef62-48c1-9c0d-beef202e00ec tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: a362c623-fa9a-4da0-b8f5-64233f2651ba] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:33.629871 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f207ab44-ef62-48c1-9c0d-beef202e00ec tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:33.630423 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f207ab44-ef62-48c1-9c0d-beef202e00ec tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:33.632282 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f207ab44-ef62-48c1-9c0d-beef202e00ec tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:33.633056 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f207ab44-ef62-48c1-9c0d-beef202e00ec tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:33.633515 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f207ab44-ef62-48c1-9c0d-beef202e00ec tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:33.633942 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f207ab44-ef62-48c1-9c0d-beef202e00ec tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:33.887399 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-f207ab44-ef62-48c1-9c0d-beef202e00ec tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:33.897341 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-f207ab44-ef62-48c1-9c0d-beef202e00ec tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba" status: 200 len: 1363 microversion: 2.1 time: 0.281020 Aug 24 03:57:33.904814 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 335/675] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:33 2022] GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba => generated 1363 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:34.174337 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f302594c-450c-447f-89cf-6702fb149f84 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:34.174956 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f302594c-450c-447f-89cf-6702fb149f84 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 0109332f-80ab-4d03-ba4d-1a24fc88fcf1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:34.182295 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f302594c-450c-447f-89cf-6702fb149f84 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:34.182821 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f302594c-450c-447f-89cf-6702fb149f84 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:34.183259 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f302594c-450c-447f-89cf-6702fb149f84 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:34.183959 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f302594c-450c-447f-89cf-6702fb149f84 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:34.184412 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f302594c-450c-447f-89cf-6702fb149f84 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:34.184846 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f302594c-450c-447f-89cf-6702fb149f84 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:34.209707 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f302594c-450c-447f-89cf-6702fb149f84 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1/ips" status: 200 len: 151 microversion: 2.1 time: 0.240179 Aug 24 03:57:34.210772 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 341/676] 10.222.0.82 () {58 vars in 1248 bytes} [Wed Aug 24 03:57:33 2022] GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1/ips => generated 151 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:57:34.918730 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-4c624cfc-8680-429f-937c-da4a5d603433 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:34.919405 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-4c624cfc-8680-429f-937c-da4a5d603433 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: a362c623-fa9a-4da0-b8f5-64233f2651ba] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:34.935908 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4c624cfc-8680-429f-937c-da4a5d603433 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:34.936320 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4c624cfc-8680-429f-937c-da4a5d603433 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:34.936763 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4c624cfc-8680-429f-937c-da4a5d603433 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:34.937474 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4c624cfc-8680-429f-937c-da4a5d603433 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:34.937929 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4c624cfc-8680-429f-937c-da4a5d603433 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:34.938351 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4c624cfc-8680-429f-937c-da4a5d603433 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:35.085510 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-4c624cfc-8680-429f-937c-da4a5d603433 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:35.099466 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-4c624cfc-8680-429f-937c-da4a5d603433 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba" status: 200 len: 1363 microversion: 2.1 time: 0.184869 Aug 24 03:57:35.100480 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 336/677] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:34 2022] GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:35.925667 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9cb625a1-9e8f-4a55-9eb0-563ff87770ed tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b79ad2d-8520-4a31-8b58-25d7d5349baf"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:35.928564 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9cb625a1-9e8f-4a55-9eb0-563ff87770ed tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 0109332f-80ab-4d03-ba4d-1a24fc88fcf1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:35.936092 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9cb625a1-9e8f-4a55-9eb0-563ff87770ed tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:35.936092 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9cb625a1-9e8f-4a55-9eb0-563ff87770ed tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:35.936092 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9cb625a1-9e8f-4a55-9eb0-563ff87770ed tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:35.936726 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9cb625a1-9e8f-4a55-9eb0-563ff87770ed tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:35.937187 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9cb625a1-9e8f-4a55-9eb0-563ff87770ed tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:35.937622 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9cb625a1-9e8f-4a55-9eb0-563ff87770ed tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:36.120876 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-3e266ca2-6b29-46bc-891a-e2a47e234189 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:36.121485 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-3e266ca2-6b29-46bc-891a-e2a47e234189 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: a362c623-fa9a-4da0-b8f5-64233f2651ba] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:36.127909 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3e266ca2-6b29-46bc-891a-e2a47e234189 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:36.128389 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3e266ca2-6b29-46bc-891a-e2a47e234189 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:36.128860 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3e266ca2-6b29-46bc-891a-e2a47e234189 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:36.129514 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3e266ca2-6b29-46bc-891a-e2a47e234189 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:36.129966 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3e266ca2-6b29-46bc-891a-e2a47e234189 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:36.130394 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3e266ca2-6b29-46bc-891a-e2a47e234189 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:36.269719 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-3e266ca2-6b29-46bc-891a-e2a47e234189 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:36.278335 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-3e266ca2-6b29-46bc-891a-e2a47e234189 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba" status: 200 len: 1363 microversion: 2.1 time: 0.161418 Aug 24 03:57:36.278927 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 337/678] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:36 2022] GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:36.283556 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-fb036c43-ac2a-4d61-89cf-bfa2ee19d826 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:36.284034 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-fb036c43-ac2a-4d61-89cf-bfa2ee19d826 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:36.289997 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-fb036c43-ac2a-4d61-89cf-bfa2ee19d826 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:36.290481 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-fb036c43-ac2a-4d61-89cf-bfa2ee19d826 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:36.290935 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-fb036c43-ac2a-4d61-89cf-bfa2ee19d826 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:36.291621 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-fb036c43-ac2a-4d61-89cf-bfa2ee19d826 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:36.292070 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-fb036c43-ac2a-4d61-89cf-bfa2ee19d826 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:36.292516 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-fb036c43-ac2a-4d61-89cf-bfa2ee19d826 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:36.378634 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.objects.instance [None req-fb036c43-ac2a-4d61-89cf-bfa2ee19d826 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lazy-loading 'services' on Instance uuid 95c868c4-fc26-429b-8f03-9edf2d7e8a70 {{(pid=127869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:57:36.767571 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-fb036c43-ac2a-4d61-89cf-bfa2ee19d826 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "DELETE /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70/os-volume_attachments/0169d1b4-a937-48d3-94ab-dd92b5a558a3" status: 202 len: 0 microversion: 2.1 time: 0.487419 Aug 24 03:57:36.768337 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 338/679] 10.222.0.82 () {58 vars in 1416 bytes} [Wed Aug 24 03:57:36 2022] DELETE /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70/os-volume_attachments/0169d1b4-a937-48d3-94ab-dd92b5a558a3 => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:57:36.777406 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-4132c936-9ed9-4992-b7c6-7dd3679bde20 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:36.779770 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-4132c936-9ed9-4992-b7c6-7dd3679bde20 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:36.785694 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4132c936-9ed9-4992-b7c6-7dd3679bde20 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:36.786181 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4132c936-9ed9-4992-b7c6-7dd3679bde20 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:36.787154 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4132c936-9ed9-4992-b7c6-7dd3679bde20 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:36.788439 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4132c936-9ed9-4992-b7c6-7dd3679bde20 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:36.788899 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4132c936-9ed9-4992-b7c6-7dd3679bde20 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:36.789332 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4132c936-9ed9-4992-b7c6-7dd3679bde20 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:36.821535 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-4132c936-9ed9-4992-b7c6-7dd3679bde20 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048328 Aug 24 03:57:36.822107 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 339/680] 10.222.0.82 () {58 vars in 1302 bytes} [Wed Aug 24 03:57:36 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:37.299351 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-50aaabef-ce41-412e-bfb5-0821aedfe759 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:37.300203 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-50aaabef-ce41-412e-bfb5-0821aedfe759 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: a362c623-fa9a-4da0-b8f5-64233f2651ba] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:37.307659 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-50aaabef-ce41-412e-bfb5-0821aedfe759 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:37.307970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9cb625a1-9e8f-4a55-9eb0-563ff87770ed tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "POST /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.386092 Aug 24 03:57:37.308411 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-50aaabef-ce41-412e-bfb5-0821aedfe759 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:37.308545 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-50aaabef-ce41-412e-bfb5-0821aedfe759 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:37.308645 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 342/681] 10.222.0.82 () {60 vars in 1323 bytes} [Wed Aug 24 03:57:35 2022] POST /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1/os-volume_attachments => generated 194 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:37.309330 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-50aaabef-ce41-412e-bfb5-0821aedfe759 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:37.309836 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-50aaabef-ce41-412e-bfb5-0821aedfe759 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:37.310258 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-50aaabef-ce41-412e-bfb5-0821aedfe759 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:37.442301 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-50aaabef-ce41-412e-bfb5-0821aedfe759 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:37.450652 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-50aaabef-ce41-412e-bfb5-0821aedfe759 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba" status: 200 len: 1363 microversion: 2.1 time: 0.155262 Aug 24 03:57:37.451224 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 340/682] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:37 2022] GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:57:37.835033 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-198ce8f5-e332-40b3-a5db-eff4cca71fea tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:37.837634 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-198ce8f5-e332-40b3-a5db-eff4cca71fea tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:37.846088 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:37.848382 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-198ce8f5-e332-40b3-a5db-eff4cca71fea tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:37.848870 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-198ce8f5-e332-40b3-a5db-eff4cca71fea tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:37.849361 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-198ce8f5-e332-40b3-a5db-eff4cca71fea tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:37.850063 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-198ce8f5-e332-40b3-a5db-eff4cca71fea tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:37.850526 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-198ce8f5-e332-40b3-a5db-eff4cca71fea tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:37.850963 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-198ce8f5-e332-40b3-a5db-eff4cca71fea tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:37.881670 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-198ce8f5-e332-40b3-a5db-eff4cca71fea tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050423 Aug 24 03:57:37.882337 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 343/683] 10.222.0.82 () {58 vars in 1302 bytes} [Wed Aug 24 03:57:37 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:38.471487 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-e63e6daf-d842-4259-9c62-7dee2048ea0b tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:38.472089 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-e63e6daf-d842-4259-9c62-7dee2048ea0b tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: a362c623-fa9a-4da0-b8f5-64233f2651ba] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:38.474044 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell0:SELECT=6 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:38.479604 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e63e6daf-d842-4259-9c62-7dee2048ea0b tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:38.482538 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e63e6daf-d842-4259-9c62-7dee2048ea0b tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:38.482538 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e63e6daf-d842-4259-9c62-7dee2048ea0b tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:38.482538 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e63e6daf-d842-4259-9c62-7dee2048ea0b tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:38.482538 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e63e6daf-d842-4259-9c62-7dee2048ea0b tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:38.482896 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e63e6daf-d842-4259-9c62-7dee2048ea0b tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:38.601364 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-4b361a8b-990d-47b7-a6e8-305dd9b86ee6 req-a74ba18d-5d08-4cee-a895-b353a7f8387e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a362c623-fa9a-4da0-b8f5-64233f2651ba", "name": "network-vif-plugged", "status": "completed", "tag": "f8530983-e556-4b26-9386-08d90e5ab898"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:38.612890 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-4b361a8b-990d-47b7-a6e8-305dd9b86ee6 req-a74ba18d-5d08-4cee-a895-b353a7f8387e service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:38.613450 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-4b361a8b-990d-47b7-a6e8-305dd9b86ee6 req-a74ba18d-5d08-4cee-a895-b353a7f8387e service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:38.613953 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-4b361a8b-990d-47b7-a6e8-305dd9b86ee6 req-a74ba18d-5d08-4cee-a895-b353a7f8387e service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:38.626186 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-4b361a8b-990d-47b7-a6e8-305dd9b86ee6 req-a74ba18d-5d08-4cee-a895-b353a7f8387e service nova] Creating event network-vif-plugged:f8530983-e556-4b26-9386-08d90e5ab898 for instance a362c623-fa9a-4da0-b8f5-64233f2651ba on hv-cinder-85426 Aug 24 03:57:38.627508 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-e63e6daf-d842-4259-9c62-7dee2048ea0b tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:38.632183 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-4b361a8b-990d-47b7-a6e8-305dd9b86ee6 req-a74ba18d-5d08-4cee-a895-b353a7f8387e service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033894 Aug 24 03:57:38.633017 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 344/684] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:38.637218 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-e63e6daf-d842-4259-9c62-7dee2048ea0b tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba" status: 200 len: 1363 microversion: 2.1 time: 0.169450 Aug 24 03:57:38.637849 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 341/685] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:38 2022] GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:38.894322 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b28e359b-8110-4a72-9e46-dad85c09e4c0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:38.896789 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b28e359b-8110-4a72-9e46-dad85c09e4c0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:38.903217 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b28e359b-8110-4a72-9e46-dad85c09e4c0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:38.903703 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b28e359b-8110-4a72-9e46-dad85c09e4c0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:38.904174 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b28e359b-8110-4a72-9e46-dad85c09e4c0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:38.904871 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b28e359b-8110-4a72-9e46-dad85c09e4c0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:38.905337 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b28e359b-8110-4a72-9e46-dad85c09e4c0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:38.905762 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b28e359b-8110-4a72-9e46-dad85c09e4c0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:38.935186 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b28e359b-8110-4a72-9e46-dad85c09e4c0 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045134 Aug 24 03:57:38.935751 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 345/686] 10.222.0.82 () {58 vars in 1302 bytes} [Wed Aug 24 03:57:38 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:57:39.019405 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-323fe332-64e1-49b4-b1c1-7767de2a0521 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:39.020771 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-323fe332-64e1-49b4-b1c1-7767de2a0521 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:39.027327 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-323fe332-64e1-49b4-b1c1-7767de2a0521 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:39.027800 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-323fe332-64e1-49b4-b1c1-7767de2a0521 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:39.028225 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-323fe332-64e1-49b4-b1c1-7767de2a0521 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:39.029030 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-323fe332-64e1-49b4-b1c1-7767de2a0521 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:39.029546 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-323fe332-64e1-49b4-b1c1-7767de2a0521 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:39.029988 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-323fe332-64e1-49b4-b1c1-7767de2a0521 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:39.056691 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-323fe332-64e1-49b4-b1c1-7767de2a0521 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Going to try to terminate instance {{(pid=127869) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:57:39.332592 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-323fe332-64e1-49b4-b1c1-7767de2a0521 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "DELETE /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 204 len: 0 microversion: 2.1 time: 0.318519 Aug 24 03:57:39.333288 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 342/687] 10.222.0.82 () {58 vars in 1239 bytes} [Wed Aug 24 03:57:39 2022] DELETE /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:57:39.342359 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bb1a2137-393e-49d3-a325-81ad23236caf tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:39.345864 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bb1a2137-393e-49d3-a325-81ad23236caf tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:39.345864 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=8 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:39.349673 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb1a2137-393e-49d3-a325-81ad23236caf tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:39.350842 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb1a2137-393e-49d3-a325-81ad23236caf tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:39.351387 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb1a2137-393e-49d3-a325-81ad23236caf tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:39.352081 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb1a2137-393e-49d3-a325-81ad23236caf tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:39.352541 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb1a2137-393e-49d3-a325-81ad23236caf tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:39.352961 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb1a2137-393e-49d3-a325-81ad23236caf tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:39.491724 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-bb1a2137-393e-49d3-a325-81ad23236caf tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:39.499549 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bb1a2137-393e-49d3-a325-81ad23236caf tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1687 microversion: 2.1 time: 0.161347 Aug 24 03:57:39.500111 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 346/688] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:39 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1687 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:39.658522 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-e72774bb-5bc5-428f-8128-f6ed7e2fd5bd tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:39.659234 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-e72774bb-5bc5-428f-8128-f6ed7e2fd5bd tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: a362c623-fa9a-4da0-b8f5-64233f2651ba] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:39.667251 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e72774bb-5bc5-428f-8128-f6ed7e2fd5bd tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:39.667755 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e72774bb-5bc5-428f-8128-f6ed7e2fd5bd tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:39.668185 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e72774bb-5bc5-428f-8128-f6ed7e2fd5bd tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:39.668895 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e72774bb-5bc5-428f-8128-f6ed7e2fd5bd tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:39.669344 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e72774bb-5bc5-428f-8128-f6ed7e2fd5bd tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:39.669761 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e72774bb-5bc5-428f-8128-f6ed7e2fd5bd tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:39.804243 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-e72774bb-5bc5-428f-8128-f6ed7e2fd5bd tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:39.812171 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-e72774bb-5bc5-428f-8128-f6ed7e2fd5bd tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba" status: 200 len: 1363 microversion: 2.1 time: 0.157827 Aug 24 03:57:39.812750 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 343/689] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:39 2022] GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:40.521443 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a6a5e585-d5c5-4011-ae78-f25f2cce9839 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:40.522206 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a6a5e585-d5c5-4011-ae78-f25f2cce9839 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:40.528552 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a6a5e585-d5c5-4011-ae78-f25f2cce9839 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:40.529032 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a6a5e585-d5c5-4011-ae78-f25f2cce9839 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:40.529462 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a6a5e585-d5c5-4011-ae78-f25f2cce9839 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:40.530310 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a6a5e585-d5c5-4011-ae78-f25f2cce9839 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:40.530779 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a6a5e585-d5c5-4011-ae78-f25f2cce9839 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:40.531197 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a6a5e585-d5c5-4011-ae78-f25f2cce9839 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:40.671112 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-a6a5e585-d5c5-4011-ae78-f25f2cce9839 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:40.680596 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a6a5e585-d5c5-4011-ae78-f25f2cce9839 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1687 microversion: 2.1 time: 0.163045 Aug 24 03:57:40.682638 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 347/690] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:40 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1687 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:40.833161 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-a307a60e-4ee6-4acd-8fcf-401d0d5534f8 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:40.833669 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-a307a60e-4ee6-4acd-8fcf-401d0d5534f8 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: a362c623-fa9a-4da0-b8f5-64233f2651ba] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:40.841276 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a307a60e-4ee6-4acd-8fcf-401d0d5534f8 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:40.841736 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a307a60e-4ee6-4acd-8fcf-401d0d5534f8 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:40.842170 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a307a60e-4ee6-4acd-8fcf-401d0d5534f8 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:40.842902 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a307a60e-4ee6-4acd-8fcf-401d0d5534f8 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:40.843356 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a307a60e-4ee6-4acd-8fcf-401d0d5534f8 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:40.843777 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a307a60e-4ee6-4acd-8fcf-401d0d5534f8 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:40.976091 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-a307a60e-4ee6-4acd-8fcf-401d0d5534f8 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:40.983744 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-a307a60e-4ee6-4acd-8fcf-401d0d5534f8 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba" status: 200 len: 1363 microversion: 2.1 time: 0.154565 Aug 24 03:57:40.984310 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 344/691] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:40 2022] GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:41.702000 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-654a1d96-93c9-43f6-83dd-94c505d97355 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:41.702557 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-654a1d96-93c9-43f6-83dd-94c505d97355 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:41.704847 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:41.709761 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-654a1d96-93c9-43f6-83dd-94c505d97355 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:41.710235 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-654a1d96-93c9-43f6-83dd-94c505d97355 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:41.710692 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-654a1d96-93c9-43f6-83dd-94c505d97355 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:41.723097 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-654a1d96-93c9-43f6-83dd-94c505d97355 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:41.723097 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-654a1d96-93c9-43f6-83dd-94c505d97355 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:41.723097 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-654a1d96-93c9-43f6-83dd-94c505d97355 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:41.842525 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-654a1d96-93c9-43f6-83dd-94c505d97355 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:41.850426 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-654a1d96-93c9-43f6-83dd-94c505d97355 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1687 microversion: 2.1 time: 0.152417 Aug 24 03:57:41.851027 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 348/692] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:41 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1687 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:42.004540 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-14d7ba80-db7e-4bac-a34c-e0fc473a8b7a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:42.005458 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-14d7ba80-db7e-4bac-a34c-e0fc473a8b7a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: a362c623-fa9a-4da0-b8f5-64233f2651ba] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:42.012698 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-14d7ba80-db7e-4bac-a34c-e0fc473a8b7a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:42.013179 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-14d7ba80-db7e-4bac-a34c-e0fc473a8b7a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:42.013614 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-14d7ba80-db7e-4bac-a34c-e0fc473a8b7a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:42.014343 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-14d7ba80-db7e-4bac-a34c-e0fc473a8b7a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:42.014833 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-14d7ba80-db7e-4bac-a34c-e0fc473a8b7a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:42.015256 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-14d7ba80-db7e-4bac-a34c-e0fc473a8b7a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:42.145881 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-14d7ba80-db7e-4bac-a34c-e0fc473a8b7a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:42.153953 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-14d7ba80-db7e-4bac-a34c-e0fc473a8b7a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba" status: 200 len: 1363 microversion: 2.1 time: 0.153361 Aug 24 03:57:42.154594 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 345/693] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:41 2022] GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:42.871479 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-16874cff-35ec-410a-83c6-db2ad02241ab tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:42.872019 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-16874cff-35ec-410a-83c6-db2ad02241ab tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:42.878288 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-16874cff-35ec-410a-83c6-db2ad02241ab tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:42.878793 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-16874cff-35ec-410a-83c6-db2ad02241ab tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:42.879225 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-16874cff-35ec-410a-83c6-db2ad02241ab tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:42.879908 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-16874cff-35ec-410a-83c6-db2ad02241ab tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:42.880363 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-16874cff-35ec-410a-83c6-db2ad02241ab tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:42.881332 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-16874cff-35ec-410a-83c6-db2ad02241ab tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:43.010156 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-16874cff-35ec-410a-83c6-db2ad02241ab tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:43.018345 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-16874cff-35ec-410a-83c6-db2ad02241ab tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1687 microversion: 2.1 time: 0.150775 Aug 24 03:57:43.018959 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 349/694] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:42 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1687 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:43.176303 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-6b6bdb24-1c73-42c6-a390-19db06cabf17 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:43.177015 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-6b6bdb24-1c73-42c6-a390-19db06cabf17 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: a362c623-fa9a-4da0-b8f5-64233f2651ba] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:43.184299 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6b6bdb24-1c73-42c6-a390-19db06cabf17 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:43.184776 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6b6bdb24-1c73-42c6-a390-19db06cabf17 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:43.185207 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6b6bdb24-1c73-42c6-a390-19db06cabf17 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:43.185882 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6b6bdb24-1c73-42c6-a390-19db06cabf17 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:43.186325 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6b6bdb24-1c73-42c6-a390-19db06cabf17 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:43.186765 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6b6bdb24-1c73-42c6-a390-19db06cabf17 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:43.205303 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:43.320754 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-6b6bdb24-1c73-42c6-a390-19db06cabf17 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:43.328224 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-6b6bdb24-1c73-42c6-a390-19db06cabf17 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba" status: 200 len: 1363 microversion: 2.1 time: 0.155764 Aug 24 03:57:43.328789 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 346/695] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:43 2022] GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:44.040957 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-551ea0c9-600d-4769-b517-3399abdc91ca tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:44.041568 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-551ea0c9-600d-4769-b517-3399abdc91ca tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:44.048044 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-551ea0c9-600d-4769-b517-3399abdc91ca tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:44.048663 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-551ea0c9-600d-4769-b517-3399abdc91ca tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:44.049097 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-551ea0c9-600d-4769-b517-3399abdc91ca tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:44.049790 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-551ea0c9-600d-4769-b517-3399abdc91ca tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:44.050241 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-551ea0c9-600d-4769-b517-3399abdc91ca tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:44.050698 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-551ea0c9-600d-4769-b517-3399abdc91ca tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:44.198343 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-551ea0c9-600d-4769-b517-3399abdc91ca tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:44.206078 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-551ea0c9-600d-4769-b517-3399abdc91ca tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1687 microversion: 2.1 time: 0.170034 Aug 24 03:57:44.206710 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 350/696] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:44 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1687 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:57:44.349164 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-b80df49c-afc2-4ee4-b6ef-c98e3b16308f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:44.350436 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-b80df49c-afc2-4ee4-b6ef-c98e3b16308f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: a362c623-fa9a-4da0-b8f5-64233f2651ba] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:44.357706 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b80df49c-afc2-4ee4-b6ef-c98e3b16308f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:44.358193 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b80df49c-afc2-4ee4-b6ef-c98e3b16308f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:44.358666 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b80df49c-afc2-4ee4-b6ef-c98e3b16308f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:44.359360 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b80df49c-afc2-4ee4-b6ef-c98e3b16308f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:44.359807 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b80df49c-afc2-4ee4-b6ef-c98e3b16308f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:44.360225 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b80df49c-afc2-4ee4-b6ef-c98e3b16308f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:44.545585 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-b80df49c-afc2-4ee4-b6ef-c98e3b16308f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:44.553894 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-b80df49c-afc2-4ee4-b6ef-c98e3b16308f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba" status: 200 len: 1549 microversion: 2.1 time: 0.208947 Aug 24 03:57:44.554450 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 347/697] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:44 2022] GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba => generated 1549 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:44.573896 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-153a9cde-1252-4490-9793-fd360e8c093a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:44.574317 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-153a9cde-1252-4490-9793-fd360e8c093a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: a362c623-fa9a-4da0-b8f5-64233f2651ba] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:44.580396 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-153a9cde-1252-4490-9793-fd360e8c093a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:44.586877 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-153a9cde-1252-4490-9793-fd360e8c093a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:44.586877 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-153a9cde-1252-4490-9793-fd360e8c093a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:44.586877 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-153a9cde-1252-4490-9793-fd360e8c093a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:44.586877 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-153a9cde-1252-4490-9793-fd360e8c093a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:44.587218 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-153a9cde-1252-4490-9793-fd360e8c093a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:44.587218 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:44.669360 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-153a9cde-1252-4490-9793-fd360e8c093a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099263 Aug 24 03:57:44.669987 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 351/698] 10.222.0.82 () {58 vars in 1275 bytes} [Wed Aug 24 03:57:44 2022] GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:45.189948 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-941ab588-09b2-4ec0-8aa1-e28bd9801a15 req-8532c23b-8a9f-4aa8-ad84-ada56ec3e549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95c868c4-fc26-429b-8f03-9edf2d7e8a70", "name": "network-vif-deleted", "tag": "1d5cfffb-87d1-418d-8955-91c69e97af1e"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:45.200370 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-941ab588-09b2-4ec0-8aa1-e28bd9801a15 req-8532c23b-8a9f-4aa8-ad84-ada56ec3e549 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:45.201218 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-941ab588-09b2-4ec0-8aa1-e28bd9801a15 req-8532c23b-8a9f-4aa8-ad84-ada56ec3e549 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:45.201859 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-941ab588-09b2-4ec0-8aa1-e28bd9801a15 req-8532c23b-8a9f-4aa8-ad84-ada56ec3e549 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:45.214898 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-941ab588-09b2-4ec0-8aa1-e28bd9801a15 req-8532c23b-8a9f-4aa8-ad84-ada56ec3e549 service nova] Creating event network-vif-deleted:1d5cfffb-87d1-418d-8955-91c69e97af1e for instance 95c868c4-fc26-429b-8f03-9edf2d7e8a70 on hv-cinder-85426 Aug 24 03:57:45.220434 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-941ab588-09b2-4ec0-8aa1-e28bd9801a15 req-8532c23b-8a9f-4aa8-ad84-ada56ec3e549 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.233658 Aug 24 03:57:45.225825 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 348/699] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:45.229191 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-00986381-da48-495c-a70b-b61812b3c4a8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:45.229874 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-00986381-da48-495c-a70b-b61812b3c4a8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:45.236658 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00986381-da48-495c-a70b-b61812b3c4a8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:45.237212 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00986381-da48-495c-a70b-b61812b3c4a8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:45.237723 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00986381-da48-495c-a70b-b61812b3c4a8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:45.238554 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00986381-da48-495c-a70b-b61812b3c4a8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:45.239392 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00986381-da48-495c-a70b-b61812b3c4a8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:45.240789 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-00986381-da48-495c-a70b-b61812b3c4a8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:45.311850 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-00986381-da48-495c-a70b-b61812b3c4a8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:45.321927 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-00986381-da48-495c-a70b-b61812b3c4a8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 200 len: 1620 microversion: 2.1 time: 0.098493 Aug 24 03:57:45.323313 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 352/700] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:45 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 1620 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:57:45.893630 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-3f25b754-36a6-4157-b3ac-de53cd784584 req-77e1dd1a-4bd9-4d6e-94ab-3ede803525f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a362c623-fa9a-4da0-b8f5-64233f2651ba", "tag": "f8530983-e556-4b26-9386-08d90e5ab898"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:45.910496 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-3f25b754-36a6-4157-b3ac-de53cd784584 req-77e1dd1a-4bd9-4d6e-94ab-3ede803525f0 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:45.910496 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-3f25b754-36a6-4157-b3ac-de53cd784584 req-77e1dd1a-4bd9-4d6e-94ab-3ede803525f0 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:45.911351 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-3f25b754-36a6-4157-b3ac-de53cd784584 req-77e1dd1a-4bd9-4d6e-94ab-3ede803525f0 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:45.924198 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-3f25b754-36a6-4157-b3ac-de53cd784584 req-77e1dd1a-4bd9-4d6e-94ab-3ede803525f0 service nova] Creating event network-changed:f8530983-e556-4b26-9386-08d90e5ab898 for instance a362c623-fa9a-4da0-b8f5-64233f2651ba on hv-cinder-85426 Aug 24 03:57:45.930021 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-3f25b754-36a6-4157-b3ac-de53cd784584 req-77e1dd1a-4bd9-4d6e-94ab-3ede803525f0 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128815 Aug 24 03:57:45.931007 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 349/701] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:57:45.978170 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9c72ba26-4100-4914-9fc1-c01a163cf2fd tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b79ad2d-8520-4a31-8b58-25d7d5349baf"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:45.980743 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9c72ba26-4100-4914-9fc1-c01a163cf2fd tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 0109332f-80ab-4d03-ba4d-1a24fc88fcf1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:45.992101 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c72ba26-4100-4914-9fc1-c01a163cf2fd tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:45.992971 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c72ba26-4100-4914-9fc1-c01a163cf2fd tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:45.993578 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c72ba26-4100-4914-9fc1-c01a163cf2fd tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:45.994446 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c72ba26-4100-4914-9fc1-c01a163cf2fd tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:45.995079 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c72ba26-4100-4914-9fc1-c01a163cf2fd tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:45.995904 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c72ba26-4100-4914-9fc1-c01a163cf2fd tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:46.132320 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-9c72ba26-4100-4914-9fc1-c01a163cf2fd tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] HTTP exception thrown: Invalid volume: volume 7b79ad2d-8520-4a31-8b58-25d7d5349baf is already attached to instances: 0109332f-80ab-4d03-ba4d-1a24fc88fcf1 Aug 24 03:57:46.134874 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9c72ba26-4100-4914-9fc1-c01a163cf2fd tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Request method failure captured: Aug 24 03:57:46.134874 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: request: POST /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1/os-volume_attachments HTTP/1.1 Aug 24 03:57:46.134874 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept: application/json Aug 24 03:57:46.134874 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept-Encoding: identity Aug 24 03:57:46.134874 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Connection: close Aug 24 03:57:46.134874 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Length: 74 Aug 24 03:57:46.134874 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Type: application/json Aug 24 03:57:46.134874 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Host: 10.222.0.82 Aug 24 03:57:46.134874 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Openstack-System-Scope: None Aug 24 03:57:46.134874 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.11 Aug 24 03:57:46.134874 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Auth-Token: gAAAAABjBaByYUQ7dP595ip40_OJ_0ufC71Rc-FPYS4vZXmmx4Fislhg9iz6FfvLLHiwJ4Ed0bFNDX6fhqS1zmk_A3EKqVLHT9Pz2gZaaIcE0OalzJoOw2sqfwO-7iDYasbxHIEhvzvTJNavoRaspbu_b6_R5EZ70Pa8SKRgBtFA8vqfpAdszSk Aug 24 03:57:46.134874 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Id: None Aug 24 03:57:46.134874 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Name: None Aug 24 03:57:46.134874 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Identity-Status: Confirmed Aug 24 03:57:46.134874 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Is-Admin-Project: True Aug 24 03:57:46.134874 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Id: default Aug 24 03:57:46.134874 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Name: Default Aug 24 03:57:46.134874 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Id: 46ef5b02d8da4d2eac26b6ccfb35e1a4 Aug 24 03:57:46.134874 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Name: tempest-AttachVolumeNegativeTest-477133645 Aug 24 03:57:46.134874 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Role: member,reader Aug 24 03:57:46.134874 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Roles: member,reader Aug 24 03:57:46.136226 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/46ef5b02d8da4d2eac26b6ccfb35e1a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/46ef5b02d8da4d2eac26b6ccfb35e1a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/46ef5b02d8da4d2eac26b6ccfb35e1a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_46ef5b02d8da4d2eac26b6ccfb35e1a4", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:57:46.136226 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant: tempest-AttachVolumeNegativeTest-477133645 Aug 24 03:57:46.136226 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Id: 46ef5b02d8da4d2eac26b6ccfb35e1a4 Aug 24 03:57:46.136226 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-477133645 Aug 24 03:57:46.136226 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User: tempest-AttachVolumeNegativeTest-477133645-project Aug 24 03:57:46.136226 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Id: default Aug 24 03:57:46.136226 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Name: Default Aug 24 03:57:46.136226 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Id: e5582d10ebef459084fe287c18568f98 Aug 24 03:57:46.136226 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Name: tempest-AttachVolumeNegativeTest-477133645-project Aug 24 03:57:46.136226 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Aug 24 03:57:46.136226 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: {"volumeAttachment": {"volumeId": "7b79ad2d-8520-4a31-8b58-25d7d5349baf"}} Aug 24 03:57:46.136226 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: method: > Aug 24 03:57:46.137012 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: exception: Invalid volume: volume 7b79ad2d-8520-4a31-8b58-25d7d5349baf is already attached to instances: 0109332f-80ab-4d03-ba4d-1a24fc88fcf1 Aug 24 03:57:46.137012 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: action_args: {'server_id': '0109332f-80ab-4d03-ba4d-1a24fc88fcf1', 'body': {'volumeAttachment': {'volumeId': '7b79ad2d-8520-4a31-8b58-25d7d5349baf'}}} Aug 24 03:57:46.137012 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:57:46.137012 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:46.137012 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 03:57:46.137012 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 03:57:46.137012 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 03:57:46.137012 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 03:57:46.137012 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 03:57:46.137012 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 03:57:46.137012 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 03:57:46.137012 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 03:57:46.137012 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 03:57:46.137012 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 03:57:46.137012 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7b79ad2d-8520-4a31-8b58-25d7d5349baf is already attached to instances: 0109332f-80ab-4d03-ba4d-1a24fc88fcf1 Aug 24 03:57:46.137012 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:57:46.137012 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:46.137012 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:57:46.137012 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:46.144217 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:46.144217 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:46.144217 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:57:46.144217 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:57:46.144217 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:57:46.144217 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:57:46.144217 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:57:46.144217 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:57:46.144217 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:57:46.144217 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:57:46.144217 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:57:46.144217 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:57:46.144217 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 03:57:46.144217 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 03:57:46.144217 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7b79ad2d-8520-4a31-8b58-25d7d5349baf is already attached to instances: 0109332f-80ab-4d03-ba4d-1a24fc88fcf1 Aug 24 03:57:46.144217 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:57:46.144217 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:46.144217 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:57:46.144217 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:46.144217 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:46.145676 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:46.145676 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:57:46.145676 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:57:46.145676 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7b79ad2d-8520-4a31-8b58-25d7d5349baf is already attached to instances: 0109332f-80ab-4d03-ba4d-1a24fc88fcf1 Aug 24 03:57:46.145676 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:57:46.145676 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9c72ba26-4100-4914-9fc1-c01a163cf2fd tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Returning 400 to user: Invalid volume: volume 7b79ad2d-8520-4a31-8b58-25d7d5349baf is already attached to instances: 0109332f-80ab-4d03-ba4d-1a24fc88fcf1 {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:57:46.146636 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9c72ba26-4100-4914-9fc1-c01a163cf2fd tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "POST /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.171563 Aug 24 03:57:46.147652 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 353/702] 10.222.0.82 () {60 vars in 1323 bytes} [Wed Aug 24 03:57:45 2022] POST /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1/os-volume_attachments => generated 174 bytes in 175 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:57:46.237111 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-56eb3d6a-3ffd-4aaa-9f22-1d1f761d66fc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:46.237995 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-56eb3d6a-3ffd-4aaa-9f22-1d1f761d66fc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 0109332f-80ab-4d03-ba4d-1a24fc88fcf1] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:46.246632 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-56eb3d6a-3ffd-4aaa-9f22-1d1f761d66fc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:46.247355 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-56eb3d6a-3ffd-4aaa-9f22-1d1f761d66fc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:46.247945 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-56eb3d6a-3ffd-4aaa-9f22-1d1f761d66fc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:46.248934 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-56eb3d6a-3ffd-4aaa-9f22-1d1f761d66fc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:46.249542 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-56eb3d6a-3ffd-4aaa-9f22-1d1f761d66fc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:46.250148 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-56eb3d6a-3ffd-4aaa-9f22-1d1f761d66fc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:46.350054 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f2c7fbf5-e38e-451b-8c7a-af88f8497740 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:46.353668 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f2c7fbf5-e38e-451b-8c7a-af88f8497740 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 95c868c4-fc26-429b-8f03-9edf2d7e8a70] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:46.358725 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.objects.instance [None req-56eb3d6a-3ffd-4aaa-9f22-1d1f761d66fc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lazy-loading 'services' on Instance uuid 0109332f-80ab-4d03-ba4d-1a24fc88fcf1 {{(pid=127869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:57:46.371955 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f2c7fbf5-e38e-451b-8c7a-af88f8497740 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:46.372730 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f2c7fbf5-e38e-451b-8c7a-af88f8497740 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:46.373596 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f2c7fbf5-e38e-451b-8c7a-af88f8497740 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:46.374563 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f2c7fbf5-e38e-451b-8c7a-af88f8497740 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:46.378074 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f2c7fbf5-e38e-451b-8c7a-af88f8497740 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:46.383429 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f2c7fbf5-e38e-451b-8c7a-af88f8497740 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:46.406933 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-f2c7fbf5-e38e-451b-8c7a-af88f8497740 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] HTTP exception thrown: Instance 95c868c4-fc26-429b-8f03-9edf2d7e8a70 could not be found. Aug 24 03:57:46.410011 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f2c7fbf5-e38e-451b-8c7a-af88f8497740 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Request method failure captured: Aug 24 03:57:46.410011 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 HTTP/1.1 Aug 24 03:57:46.410011 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept: application/json Aug 24 03:57:46.410011 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept-Encoding: identity Aug 24 03:57:46.410011 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Connection: close Aug 24 03:57:46.410011 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Length: 0 Aug 24 03:57:46.410011 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Type: application/json Aug 24 03:57:46.410011 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Host: 10.222.0.82 Aug 24 03:57:46.410011 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Openstack-System-Scope: None Aug 24 03:57:46.410011 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.11 Aug 24 03:57:46.410011 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Auth-Token: gAAAAABjBaBwfFwtOW_HqduVs-Y72_nB0AfAGPkKiTC3c4uSLXKyBQUeIsdjnKcKqOXOXGzaPm3531c8BOjXNm1ZmlI5tsEEAgDjb8e71EXHI4eXRLl99FfDJSPPx9GmrFEVoPYMPEhZvpFFVWFOIsIGclHl28xUAF2supcEcrqrvkfNAW9RaN4 Aug 24 03:57:46.410011 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Id: None Aug 24 03:57:46.410011 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Name: None Aug 24 03:57:46.410011 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Identity-Status: Confirmed Aug 24 03:57:46.410011 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Is-Admin-Project: True Aug 24 03:57:46.410011 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Id: default Aug 24 03:57:46.410011 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Name: Default Aug 24 03:57:46.410011 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Id: 63408551e1b24a86b8f0059f1a948896 Aug 24 03:57:46.410011 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-496383813 Aug 24 03:57:46.410011 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Role: member,reader Aug 24 03:57:46.410011 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Roles: member,reader Aug 24 03:57:46.411354 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/63408551e1b24a86b8f0059f1a948896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/63408551e1b24a86b8f0059f1a948896"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/63408551e1b24a86b8f0059f1a948896"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_63408551e1b24a86b8f0059f1a948896", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:57:46.411354 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant: tempest-ServerRescueNegativeTestJSON-496383813 Aug 24 03:57:46.411354 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Id: 63408551e1b24a86b8f0059f1a948896 Aug 24 03:57:46.411354 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-496383813 Aug 24 03:57:46.411354 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User: tempest-ServerRescueNegativeTestJSON-496383813-project Aug 24 03:57:46.411354 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Id: default Aug 24 03:57:46.411354 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Name: Default Aug 24 03:57:46.411354 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Id: 547bce0d8133462c95bcb6f272776a27 Aug 24 03:57:46.411354 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Name: tempest-ServerRescueNegativeTestJSON-496383813-project Aug 24 03:57:46.411354 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: method: > Aug 24 03:57:46.411354 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: exception: Instance 95c868c4-fc26-429b-8f03-9edf2d7e8a70 could not be found. Aug 24 03:57:46.411354 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: action_args: {'id': '95c868c4-fc26-429b-8f03-9edf2d7e8a70'} Aug 24 03:57:46.412685 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:57:46.412685 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:46.412685 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:57:46.412685 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:57:46.412685 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:57:46.412685 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:57:46.412685 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:57:46.412685 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:57:46.412685 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:57:46.412685 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:57:46.412685 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95c868c4-fc26-429b-8f03-9edf2d7e8a70 could not be found. Aug 24 03:57:46.412685 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:57:46.412685 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:46.412685 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:57:46.412685 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:46.412685 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:46.412685 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:46.412685 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:57:46.412685 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:57:46.412685 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:57:46.413895 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:57:46.413895 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:57:46.413895 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:57:46.413895 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:57:46.413895 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:57:46.413895 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:57:46.413895 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:57:46.413895 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95c868c4-fc26-429b-8f03-9edf2d7e8a70 could not be found. Aug 24 03:57:46.413895 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:57:46.413895 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:46.413895 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:57:46.413895 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:46.413895 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:46.413895 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:46.413895 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:57:46.413895 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:57:46.413895 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95c868c4-fc26-429b-8f03-9edf2d7e8a70 could not be found. Aug 24 03:57:46.413895 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:57:46.416922 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f2c7fbf5-e38e-451b-8c7a-af88f8497740 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Returning 404 to user: Instance 95c868c4-fc26-429b-8f03-9edf2d7e8a70 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:57:46.418316 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f2c7fbf5-e38e-451b-8c7a-af88f8497740 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70" status: 404 len: 111 microversion: 2.1 time: 0.077994 Aug 24 03:57:46.419417 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 354/703] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:46 2022] GET /compute/v2.1/servers/95c868c4-fc26-429b-8f03-9edf2d7e8a70 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:57:46.428407 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-49531f69-5077-43f7-8865-07fe957fe3e8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '.version_select at 0x7f155418a790>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:46.581000 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-49531f69-5077-43f7-8865-07fe957fe3e8 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1697432519" status: 202 len: 0 microversion: 2.1 time: 0.157350 Aug 24 03:57:46.586267 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 355/704] 10.222.0.82 () {58 vars in 1221 bytes} [Wed Aug 24 03:57:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1697432519 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:57:46.677291 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-56eb3d6a-3ffd-4aaa-9f22-1d1f761d66fc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "DELETE /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1/os-volume_attachments/7b79ad2d-8520-4a31-8b58-25d7d5349baf" status: 202 len: 0 microversion: 2.1 time: 0.444553 Aug 24 03:57:46.682627 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 350/705] 10.222.0.82 () {58 vars in 1416 bytes} [Wed Aug 24 03:57:46 2022] DELETE /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1/os-volume_attachments/7b79ad2d-8520-4a31-8b58-25d7d5349baf => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:57:46.688619 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-36a09c01-65e9-4f50-9cca-026824fd90b3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:46.690662 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-36a09c01-65e9-4f50-9cca-026824fd90b3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 0109332f-80ab-4d03-ba4d-1a24fc88fcf1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:46.704101 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-36a09c01-65e9-4f50-9cca-026824fd90b3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:46.704623 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-36a09c01-65e9-4f50-9cca-026824fd90b3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:46.705056 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-36a09c01-65e9-4f50-9cca-026824fd90b3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:46.705761 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-36a09c01-65e9-4f50-9cca-026824fd90b3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:46.706363 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-36a09c01-65e9-4f50-9cca-026824fd90b3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:46.707265 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-36a09c01-65e9-4f50-9cca-026824fd90b3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:46.751493 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-36a09c01-65e9-4f50-9cca-026824fd90b3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067575 Aug 24 03:57:46.752130 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 356/706] 10.222.0.82 () {58 vars in 1302 bytes} [Wed Aug 24 03:57:46 2022] GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:57:47.766739 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-a9e5983e-9a67-48e1-a3ad-b32b3c1630f3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:47.768912 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-a9e5983e-9a67-48e1-a3ad-b32b3c1630f3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 0109332f-80ab-4d03-ba4d-1a24fc88fcf1] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:47.776874 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a9e5983e-9a67-48e1-a3ad-b32b3c1630f3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:47.777354 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a9e5983e-9a67-48e1-a3ad-b32b3c1630f3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:47.777777 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a9e5983e-9a67-48e1-a3ad-b32b3c1630f3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:47.778455 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a9e5983e-9a67-48e1-a3ad-b32b3c1630f3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:47.779167 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a9e5983e-9a67-48e1-a3ad-b32b3c1630f3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:47.779598 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a9e5983e-9a67-48e1-a3ad-b32b3c1630f3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:47.811688 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-a9e5983e-9a67-48e1-a3ad-b32b3c1630f3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050092 Aug 24 03:57:47.812451 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 351/707] 10.222.0.82 () {58 vars in 1302 bytes} [Wed Aug 24 03:57:47 2022] GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:48.825139 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5a0a901e-ff1b-4e2d-94c3-d582e7e573f0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:48.827204 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5a0a901e-ff1b-4e2d-94c3-d582e7e573f0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 0109332f-80ab-4d03-ba4d-1a24fc88fcf1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:48.834435 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5a0a901e-ff1b-4e2d-94c3-d582e7e573f0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:48.834963 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5a0a901e-ff1b-4e2d-94c3-d582e7e573f0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:48.835407 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5a0a901e-ff1b-4e2d-94c3-d582e7e573f0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:48.836099 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5a0a901e-ff1b-4e2d-94c3-d582e7e573f0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:48.836553 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5a0a901e-ff1b-4e2d-94c3-d582e7e573f0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:48.836977 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5a0a901e-ff1b-4e2d-94c3-d582e7e573f0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:48.865142 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5a0a901e-ff1b-4e2d-94c3-d582e7e573f0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044311 Aug 24 03:57:48.865721 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 357/708] 10.222.0.82 () {58 vars in 1302 bytes} [Wed Aug 24 03:57:48 2022] GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:57:48.934184 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-4963f2bd-22bd-4480-b48d-c70822255df0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:48.934734 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-4963f2bd-22bd-4480-b48d-c70822255df0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 0109332f-80ab-4d03-ba4d-1a24fc88fcf1] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:48.941062 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4963f2bd-22bd-4480-b48d-c70822255df0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:48.941537 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4963f2bd-22bd-4480-b48d-c70822255df0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:48.941968 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4963f2bd-22bd-4480-b48d-c70822255df0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:48.943274 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4963f2bd-22bd-4480-b48d-c70822255df0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:48.943919 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4963f2bd-22bd-4480-b48d-c70822255df0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:48.944485 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4963f2bd-22bd-4480-b48d-c70822255df0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:48.970127 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-4963f2bd-22bd-4480-b48d-c70822255df0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 0109332f-80ab-4d03-ba4d-1a24fc88fcf1] Going to try to terminate instance {{(pid=127869) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:57:49.320066 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-4963f2bd-22bd-4480-b48d-c70822255df0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "DELETE /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1" status: 204 len: 0 microversion: 2.1 time: 0.389476 Aug 24 03:57:49.320756 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 352/709] 10.222.0.82 () {58 vars in 1239 bytes} [Wed Aug 24 03:57:48 2022] DELETE /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:57:49.329333 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-577e9544-f9e7-433f-8c7f-3793b5b1669f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:49.330033 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-577e9544-f9e7-433f-8c7f-3793b5b1669f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 0109332f-80ab-4d03-ba4d-1a24fc88fcf1] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:49.336398 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-577e9544-f9e7-433f-8c7f-3793b5b1669f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:49.336907 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-577e9544-f9e7-433f-8c7f-3793b5b1669f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:49.337338 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-577e9544-f9e7-433f-8c7f-3793b5b1669f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:49.338029 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-577e9544-f9e7-433f-8c7f-3793b5b1669f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:49.338478 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-577e9544-f9e7-433f-8c7f-3793b5b1669f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:49.338938 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-577e9544-f9e7-433f-8c7f-3793b5b1669f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:49.440407 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cc1ff32e-324e-4c88-a788-69b0205e77f3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:49.440901 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cc1ff32e-324e-4c88-a788-69b0205e77f3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:49.448170 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cc1ff32e-324e-4c88-a788-69b0205e77f3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:49.448935 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cc1ff32e-324e-4c88-a788-69b0205e77f3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:49.449380 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cc1ff32e-324e-4c88-a788-69b0205e77f3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:49.450079 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cc1ff32e-324e-4c88-a788-69b0205e77f3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:49.450588 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cc1ff32e-324e-4c88-a788-69b0205e77f3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:49.451017 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cc1ff32e-324e-4c88-a788-69b0205e77f3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:49.477840 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cc1ff32e-324e-4c88-a788-69b0205e77f3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e/ips" status: 200 len: 153 microversion: 2.20 time: 0.152782 Aug 24 03:57:49.478451 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 358/710] 10.222.0.82 () {60 vars in 1289 bytes} [Wed Aug 24 03:57:49 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e/ips => generated 153 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:57:49.480255 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-577e9544-f9e7-433f-8c7f-3793b5b1669f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:49.491067 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-577e9544-f9e7-433f-8c7f-3793b5b1669f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1" status: 200 len: 1682 microversion: 2.1 time: 0.165514 Aug 24 03:57:49.491744 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 353/711] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:49 2022] GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:57:50.176189 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c4d5c14d-e872-4ad2-ba45-02876f9432ed tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:50.176866 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c4d5c14d-e872-4ad2-ba45-02876f9432ed tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:50.186474 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4d5c14d-e872-4ad2-ba45-02876f9432ed tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:50.187074 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4d5c14d-e872-4ad2-ba45-02876f9432ed tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:50.188007 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4d5c14d-e872-4ad2-ba45-02876f9432ed tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:50.188724 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4d5c14d-e872-4ad2-ba45-02876f9432ed tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:50.189208 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4d5c14d-e872-4ad2-ba45-02876f9432ed tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:50.189641 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4d5c14d-e872-4ad2-ba45-02876f9432ed tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:50.217764 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c4d5c14d-e872-4ad2-ba45-02876f9432ed tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:57:50.496317 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c4d5c14d-e872-4ad2-ba45-02876f9432ed tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "DELETE /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 204 len: 0 microversion: 2.1 time: 0.326649 Aug 24 03:57:50.496835 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 359/712] 10.222.0.82 () {58 vars in 1239 bytes} [Wed Aug 24 03:57:50 2022] DELETE /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:57:50.506084 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-1816e71b-201d-4f3e-90e8-9b55873e3c12 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:50.506933 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-1816e71b-201d-4f3e-90e8-9b55873e3c12 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:50.513887 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1816e71b-201d-4f3e-90e8-9b55873e3c12 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:50.514378 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1816e71b-201d-4f3e-90e8-9b55873e3c12 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:50.514859 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1816e71b-201d-4f3e-90e8-9b55873e3c12 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:50.515255 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e73a268a-b0b3-4a79-94d8-1fea11c70cbc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:50.515546 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1816e71b-201d-4f3e-90e8-9b55873e3c12 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:50.515963 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e73a268a-b0b3-4a79-94d8-1fea11c70cbc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 0109332f-80ab-4d03-ba4d-1a24fc88fcf1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:50.516084 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1816e71b-201d-4f3e-90e8-9b55873e3c12 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:50.516453 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1816e71b-201d-4f3e-90e8-9b55873e3c12 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:50.522713 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e73a268a-b0b3-4a79-94d8-1fea11c70cbc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:50.523191 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e73a268a-b0b3-4a79-94d8-1fea11c70cbc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:50.523624 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e73a268a-b0b3-4a79-94d8-1fea11c70cbc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:50.524326 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e73a268a-b0b3-4a79-94d8-1fea11c70cbc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:50.524784 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e73a268a-b0b3-4a79-94d8-1fea11c70cbc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:50.525207 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e73a268a-b0b3-4a79-94d8-1fea11c70cbc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:50.660334 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-1816e71b-201d-4f3e-90e8-9b55873e3c12 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:50.669555 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-1816e71b-201d-4f3e-90e8-9b55873e3c12 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1508 microversion: 2.1 time: 0.168061 Aug 24 03:57:50.670187 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 354/713] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:50 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:50.834408 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-e73a268a-b0b3-4a79-94d8-1fea11c70cbc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:50.842301 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e73a268a-b0b3-4a79-94d8-1fea11c70cbc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1" status: 200 len: 1682 microversion: 2.1 time: 0.331731 Aug 24 03:57:50.842891 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 360/714] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:50 2022] GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1 => generated 1682 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:57:51.697123 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-da5888d6-6dd9-40d7-8969-2b44b8a825e7 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:51.697726 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-da5888d6-6dd9-40d7-8969-2b44b8a825e7 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:51.704118 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-da5888d6-6dd9-40d7-8969-2b44b8a825e7 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:51.704592 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-da5888d6-6dd9-40d7-8969-2b44b8a825e7 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:51.705072 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-da5888d6-6dd9-40d7-8969-2b44b8a825e7 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:51.705704 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-da5888d6-6dd9-40d7-8969-2b44b8a825e7 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:51.706149 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-da5888d6-6dd9-40d7-8969-2b44b8a825e7 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:51.706624 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-da5888d6-6dd9-40d7-8969-2b44b8a825e7 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:51.839257 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-da5888d6-6dd9-40d7-8969-2b44b8a825e7 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:51.847158 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-da5888d6-6dd9-40d7-8969-2b44b8a825e7 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1508 microversion: 2.1 time: 0.154352 Aug 24 03:57:51.847750 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 355/715] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:51 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:51.862933 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-62b42ebe-3601-4043-9197-21b4ee5b68fd tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:51.863535 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-62b42ebe-3601-4043-9197-21b4ee5b68fd tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 0109332f-80ab-4d03-ba4d-1a24fc88fcf1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:51.869958 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62b42ebe-3601-4043-9197-21b4ee5b68fd tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:51.870432 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62b42ebe-3601-4043-9197-21b4ee5b68fd tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:51.870889 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62b42ebe-3601-4043-9197-21b4ee5b68fd tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:51.871570 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62b42ebe-3601-4043-9197-21b4ee5b68fd tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:51.872014 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62b42ebe-3601-4043-9197-21b4ee5b68fd tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:51.872430 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62b42ebe-3601-4043-9197-21b4ee5b68fd tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:51.977320 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-cfc7bf19-ed24-4ba6-841a-4b9135290707 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:51.977781 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-cfc7bf19-ed24-4ba6-841a-4b9135290707 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:51.983649 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cfc7bf19-ed24-4ba6-841a-4b9135290707 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:51.984136 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cfc7bf19-ed24-4ba6-841a-4b9135290707 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:51.984574 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cfc7bf19-ed24-4ba6-841a-4b9135290707 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:51.985264 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cfc7bf19-ed24-4ba6-841a-4b9135290707 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:51.985714 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cfc7bf19-ed24-4ba6-841a-4b9135290707 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:51.986139 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cfc7bf19-ed24-4ba6-841a-4b9135290707 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:52.003651 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-62b42ebe-3601-4043-9197-21b4ee5b68fd tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:52.010277 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.objects.instance [None req-cfc7bf19-ed24-4ba6-841a-4b9135290707 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lazy-loading 'flavor' on Instance uuid df85e6fe-54b4-456b-875d-7c3b6418c40e {{(pid=127869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:57:52.012675 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-62b42ebe-3601-4043-9197-21b4ee5b68fd tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1" status: 200 len: 1682 microversion: 2.1 time: 0.153869 Aug 24 03:57:52.013257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 361/716] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:51 2022] GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:52.466765 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-cfc7bf19-ed24-4ba6-841a-4b9135290707 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "POST /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e/action" status: 202 len: 0 microversion: 2.20 time: 0.493798 Aug 24 03:57:52.467365 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 356/717] 10.222.0.82 () {62 vars in 1319 bytes} [Wed Aug 24 03:57:51 2022] POST /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e/action => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:57:52.476258 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5210a1fb-6a92-458a-91e7-683f09d597de tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:52.476885 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5210a1fb-6a92-458a-91e7-683f09d597de tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:52.482826 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5210a1fb-6a92-458a-91e7-683f09d597de tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:52.483309 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5210a1fb-6a92-458a-91e7-683f09d597de tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:52.483744 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5210a1fb-6a92-458a-91e7-683f09d597de tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:52.484431 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5210a1fb-6a92-458a-91e7-683f09d597de tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:52.484885 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5210a1fb-6a92-458a-91e7-683f09d597de tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:52.485306 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5210a1fb-6a92-458a-91e7-683f09d597de tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:52.618773 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-5210a1fb-6a92-458a-91e7-683f09d597de tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:52.626929 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-5210a1fb-6a92-458a-91e7-683f09d597de tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:52.628449 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-5210a1fb-6a92-458a-91e7-683f09d597de tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:52.629599 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5210a1fb-6a92-458a-91e7-683f09d597de tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1724 microversion: 2.20 time: 0.157888 Aug 24 03:57:52.631023 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 362/718] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:52 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:57:52.868886 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-138e7872-68a8-4618-abc7-ad144f487974 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:52.869492 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-138e7872-68a8-4618-abc7-ad144f487974 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:52.875749 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-138e7872-68a8-4618-abc7-ad144f487974 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:52.876226 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-138e7872-68a8-4618-abc7-ad144f487974 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:52.876660 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-138e7872-68a8-4618-abc7-ad144f487974 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:52.877342 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-138e7872-68a8-4618-abc7-ad144f487974 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:52.877792 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-138e7872-68a8-4618-abc7-ad144f487974 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:52.878207 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-138e7872-68a8-4618-abc7-ad144f487974 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:53.007798 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-138e7872-68a8-4618-abc7-ad144f487974 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:53.015534 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-138e7872-68a8-4618-abc7-ad144f487974 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1508 microversion: 2.1 time: 0.151445 Aug 24 03:57:53.016251 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 357/719] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:52 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:53.034000 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-296fc7df-3924-43ee-8120-147aede28e08 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:53.035170 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-296fc7df-3924-43ee-8120-147aede28e08 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 0109332f-80ab-4d03-ba4d-1a24fc88fcf1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:53.042233 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-296fc7df-3924-43ee-8120-147aede28e08 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:53.042800 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-296fc7df-3924-43ee-8120-147aede28e08 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:53.043446 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-296fc7df-3924-43ee-8120-147aede28e08 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:53.044160 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-296fc7df-3924-43ee-8120-147aede28e08 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:53.046718 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-296fc7df-3924-43ee-8120-147aede28e08 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:53.047188 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-296fc7df-3924-43ee-8120-147aede28e08 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:53.276168 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-296fc7df-3924-43ee-8120-147aede28e08 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:53.284256 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-296fc7df-3924-43ee-8120-147aede28e08 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1" status: 200 len: 1682 microversion: 2.1 time: 0.254083 Aug 24 03:57:53.285021 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 363/720] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:53 2022] GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1 => generated 1682 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:53.657043 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-a7caa63d-b667-4bd7-91ea-7f80775c2681 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:53.657915 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-a7caa63d-b667-4bd7-91ea-7f80775c2681 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:53.668140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a7caa63d-b667-4bd7-91ea-7f80775c2681 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:53.668637 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a7caa63d-b667-4bd7-91ea-7f80775c2681 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:53.669068 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a7caa63d-b667-4bd7-91ea-7f80775c2681 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:53.669789 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a7caa63d-b667-4bd7-91ea-7f80775c2681 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:53.670424 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a7caa63d-b667-4bd7-91ea-7f80775c2681 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:53.671128 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a7caa63d-b667-4bd7-91ea-7f80775c2681 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:53.723345 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-1c83b130-66d7-4618-945c-ea9e1e9e47be req-f31da09e-c38b-41e0-ae37-d9e2ab3eda6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b3eb1f1-0fc7-492c-9fba-02f817e5614c", "name": "network-vif-deleted", "tag": "ba8506c6-f70f-4108-ae97-aa90b43d1fae"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:53.735735 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-1c83b130-66d7-4618-945c-ea9e1e9e47be req-f31da09e-c38b-41e0-ae37-d9e2ab3eda6d service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:53.736504 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-1c83b130-66d7-4618-945c-ea9e1e9e47be req-f31da09e-c38b-41e0-ae37-d9e2ab3eda6d service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:53.736923 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-1c83b130-66d7-4618-945c-ea9e1e9e47be req-f31da09e-c38b-41e0-ae37-d9e2ab3eda6d service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:53.749034 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-1c83b130-66d7-4618-945c-ea9e1e9e47be req-f31da09e-c38b-41e0-ae37-d9e2ab3eda6d service nova] Creating event network-vif-deleted:ba8506c6-f70f-4108-ae97-aa90b43d1fae for instance 9b3eb1f1-0fc7-492c-9fba-02f817e5614c on hv-cinder-85426 Aug 24 03:57:53.753741 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-1c83b130-66d7-4618-945c-ea9e1e9e47be req-f31da09e-c38b-41e0-ae37-d9e2ab3eda6d service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039283 Aug 24 03:57:53.754323 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 364/721] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:53.928509 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-a7caa63d-b667-4bd7-91ea-7f80775c2681 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:53.939358 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-a7caa63d-b667-4bd7-91ea-7f80775c2681 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:53.941095 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-a7caa63d-b667-4bd7-91ea-7f80775c2681 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:53.942337 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-a7caa63d-b667-4bd7-91ea-7f80775c2681 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1724 microversion: 2.20 time: 0.292416 Aug 24 03:57:53.943889 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 358/722] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:53 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1724 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:57:54.037170 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-efe2adca-59b8-44b0-a342-9f29e8630e22 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:54.037846 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-efe2adca-59b8-44b0-a342-9f29e8630e22 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:54.045139 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-efe2adca-59b8-44b0-a342-9f29e8630e22 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:54.045623 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-efe2adca-59b8-44b0-a342-9f29e8630e22 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:54.046234 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-efe2adca-59b8-44b0-a342-9f29e8630e22 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:54.047152 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-efe2adca-59b8-44b0-a342-9f29e8630e22 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:54.047761 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-efe2adca-59b8-44b0-a342-9f29e8630e22 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:54.048340 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-efe2adca-59b8-44b0-a342-9f29e8630e22 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:54.124575 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-efe2adca-59b8-44b0-a342-9f29e8630e22 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:54.133269 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-7dae487c-c688-45ba-b965-22000789d98d req-cd5297be-0e6b-4165-9707-ca96d4597681 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0109332f-80ab-4d03-ba4d-1a24fc88fcf1", "name": "network-vif-deleted", "tag": "6fb7eefd-3c2e-44a9-aa1e-a1eba153d019"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:54.147109 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-efe2adca-59b8-44b0-a342-9f29e8630e22 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1293 microversion: 2.1 time: 0.109931 Aug 24 03:57:54.163986 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 365/723] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:54 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1293 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:54.166581 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-7dae487c-c688-45ba-b965-22000789d98d req-cd5297be-0e6b-4165-9707-ca96d4597681 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:54.167053 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-7dae487c-c688-45ba-b965-22000789d98d req-cd5297be-0e6b-4165-9707-ca96d4597681 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:54.167483 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-7dae487c-c688-45ba-b965-22000789d98d req-cd5297be-0e6b-4165-9707-ca96d4597681 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:54.184963 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-7dae487c-c688-45ba-b965-22000789d98d req-cd5297be-0e6b-4165-9707-ca96d4597681 service nova] Creating event network-vif-deleted:6fb7eefd-3c2e-44a9-aa1e-a1eba153d019 for instance 0109332f-80ab-4d03-ba4d-1a24fc88fcf1 on hv-cinder-85426 Aug 24 03:57:54.190827 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-7dae487c-c688-45ba-b965-22000789d98d req-cd5297be-0e6b-4165-9707-ca96d4597681 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061745 Aug 24 03:57:54.191878 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 359/724] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:57:54.306782 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b25428f7-7c35-44df-aa5a-c07a7249741a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:54.307468 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b25428f7-7c35-44df-aa5a-c07a7249741a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 0109332f-80ab-4d03-ba4d-1a24fc88fcf1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:54.314387 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b25428f7-7c35-44df-aa5a-c07a7249741a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:54.314915 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b25428f7-7c35-44df-aa5a-c07a7249741a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:54.315343 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b25428f7-7c35-44df-aa5a-c07a7249741a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:54.316023 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b25428f7-7c35-44df-aa5a-c07a7249741a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:54.316468 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b25428f7-7c35-44df-aa5a-c07a7249741a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:54.316878 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b25428f7-7c35-44df-aa5a-c07a7249741a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:54.384356 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-b25428f7-7c35-44df-aa5a-c07a7249741a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:54.392305 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b25428f7-7c35-44df-aa5a-c07a7249741a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1" status: 200 len: 1615 microversion: 2.1 time: 0.090626 Aug 24 03:57:54.398599 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 366/725] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:54 2022] GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1 => generated 1615 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:54.966641 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-2c7281d0-0dac-49bb-9f25-a86d55d166b0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:54.967337 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-2c7281d0-0dac-49bb-9f25-a86d55d166b0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:54.973629 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2c7281d0-0dac-49bb-9f25-a86d55d166b0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:54.974145 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2c7281d0-0dac-49bb-9f25-a86d55d166b0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:54.974785 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2c7281d0-0dac-49bb-9f25-a86d55d166b0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:54.975499 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2c7281d0-0dac-49bb-9f25-a86d55d166b0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:54.975954 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2c7281d0-0dac-49bb-9f25-a86d55d166b0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:54.976375 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2c7281d0-0dac-49bb-9f25-a86d55d166b0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:55.123976 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-2c7281d0-0dac-49bb-9f25-a86d55d166b0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:55.128095 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:55.134495 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-2c7281d0-0dac-49bb-9f25-a86d55d166b0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:55.136059 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-2c7281d0-0dac-49bb-9f25-a86d55d166b0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:55.137303 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-2c7281d0-0dac-49bb-9f25-a86d55d166b0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1724 microversion: 2.20 time: 0.175448 Aug 24 03:57:55.137850 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 360/726] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:54 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:57:55.168392 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f6c42344-2029-4f04-a477-bc9ceb6e878d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:55.169000 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f6c42344-2029-4f04-a477-bc9ceb6e878d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:55.175490 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f6c42344-2029-4f04-a477-bc9ceb6e878d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:55.177689 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f6c42344-2029-4f04-a477-bc9ceb6e878d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:55.177689 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f6c42344-2029-4f04-a477-bc9ceb6e878d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:55.178080 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f6c42344-2029-4f04-a477-bc9ceb6e878d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:55.178556 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f6c42344-2029-4f04-a477-bc9ceb6e878d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:55.179083 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f6c42344-2029-4f04-a477-bc9ceb6e878d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:55.216723 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f6c42344-2029-4f04-a477-bc9ceb6e878d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:55.217966 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f6c42344-2029-4f04-a477-bc9ceb6e878d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:55.218832 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f6c42344-2029-4f04-a477-bc9ceb6e878d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:55.219667 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-f6c42344-2029-4f04-a477-bc9ceb6e878d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lazy-loading 'fault' on Instance uuid 9b3eb1f1-0fc7-492c-9fba-02f817e5614c {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:57:55.271899 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-f6c42344-2029-4f04-a477-bc9ceb6e878d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:55.279767 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f6c42344-2029-4f04-a477-bc9ceb6e878d tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 200 len: 1312 microversion: 2.1 time: 0.115448 Aug 24 03:57:55.280331 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 367/727] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:55 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 1312 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:57:55.415533 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-3ffeaf01-ae94-4e83-90b6-36c885f4befa tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:55.416133 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-3ffeaf01-ae94-4e83-90b6-36c885f4befa tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 0109332f-80ab-4d03-ba4d-1a24fc88fcf1] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:55.422390 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3ffeaf01-ae94-4e83-90b6-36c885f4befa tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:55.422885 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3ffeaf01-ae94-4e83-90b6-36c885f4befa tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:55.423305 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3ffeaf01-ae94-4e83-90b6-36c885f4befa tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:55.423976 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3ffeaf01-ae94-4e83-90b6-36c885f4befa tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:55.424414 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3ffeaf01-ae94-4e83-90b6-36c885f4befa tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:55.424823 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3ffeaf01-ae94-4e83-90b6-36c885f4befa tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:55.456549 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3ffeaf01-ae94-4e83-90b6-36c885f4befa tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:55.457049 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3ffeaf01-ae94-4e83-90b6-36c885f4befa tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:55.457477 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3ffeaf01-ae94-4e83-90b6-36c885f4befa tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:55.458321 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.objects.instance [None req-3ffeaf01-ae94-4e83-90b6-36c885f4befa tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lazy-loading 'fault' on Instance uuid 0109332f-80ab-4d03-ba4d-1a24fc88fcf1 {{(pid=127869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:57:55.499781 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-3ffeaf01-ae94-4e83-90b6-36c885f4befa tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:55.507343 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-3ffeaf01-ae94-4e83-90b6-36c885f4befa tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1" status: 200 len: 1331 microversion: 2.1 time: 0.096124 Aug 24 03:57:55.507960 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 361/728] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:55 2022] GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1 => generated 1331 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:56.160585 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-75904c97-08e1-40a2-a3b1-c48b35c337ad tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:56.161881 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-75904c97-08e1-40a2-a3b1-c48b35c337ad tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:56.167779 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-75904c97-08e1-40a2-a3b1-c48b35c337ad tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:56.168252 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-75904c97-08e1-40a2-a3b1-c48b35c337ad tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:56.168678 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-75904c97-08e1-40a2-a3b1-c48b35c337ad tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:56.169349 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-75904c97-08e1-40a2-a3b1-c48b35c337ad tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:56.169790 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-75904c97-08e1-40a2-a3b1-c48b35c337ad tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:56.170203 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-75904c97-08e1-40a2-a3b1-c48b35c337ad tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:56.301224 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-75904c97-08e1-40a2-a3b1-c48b35c337ad tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:56.305012 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:56.305794 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-3eb1f774-466f-4788-901d-4d77ffe316ca tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:56.306432 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-3eb1f774-466f-4788-901d-4d77ffe316ca tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 9b3eb1f1-0fc7-492c-9fba-02f817e5614c] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:56.310020 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-75904c97-08e1-40a2-a3b1-c48b35c337ad tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:56.313102 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-75904c97-08e1-40a2-a3b1-c48b35c337ad tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:56.313102 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-75904c97-08e1-40a2-a3b1-c48b35c337ad tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1724 microversion: 2.20 time: 0.156131 Aug 24 03:57:56.313294 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3eb1f774-466f-4788-901d-4d77ffe316ca tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:56.313389 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 368/729] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:56 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:57:56.313726 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3eb1f774-466f-4788-901d-4d77ffe316ca tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:56.314154 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3eb1f774-466f-4788-901d-4d77ffe316ca tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:56.314873 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3eb1f774-466f-4788-901d-4d77ffe316ca tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:56.315346 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3eb1f774-466f-4788-901d-4d77ffe316ca tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:56.315758 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-3eb1f774-466f-4788-901d-4d77ffe316ca tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:56.332117 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.wsgi [None req-3eb1f774-466f-4788-901d-4d77ffe316ca tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] HTTP exception thrown: Instance 9b3eb1f1-0fc7-492c-9fba-02f817e5614c could not be found. Aug 24 03:57:56.333915 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-3eb1f774-466f-4788-901d-4d77ffe316ca tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Request method failure captured: Aug 24 03:57:56.333915 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: request: GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c HTTP/1.1 Aug 24 03:57:56.333915 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept: application/json Aug 24 03:57:56.333915 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept-Encoding: identity Aug 24 03:57:56.333915 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Connection: close Aug 24 03:57:56.333915 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Length: 0 Aug 24 03:57:56.333915 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Type: application/json Aug 24 03:57:56.333915 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Host: 10.222.0.82 Aug 24 03:57:56.333915 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Openstack-System-Scope: None Aug 24 03:57:56.333915 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: User-Agent: python-urllib3/1.26.11 Aug 24 03:57:56.333915 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Auth-Token: gAAAAABjBaBwfFwtOW_HqduVs-Y72_nB0AfAGPkKiTC3c4uSLXKyBQUeIsdjnKcKqOXOXGzaPm3531c8BOjXNm1ZmlI5tsEEAgDjb8e71EXHI4eXRLl99FfDJSPPx9GmrFEVoPYMPEhZvpFFVWFOIsIGclHl28xUAF2supcEcrqrvkfNAW9RaN4 Aug 24 03:57:56.333915 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Id: None Aug 24 03:57:56.333915 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Name: None Aug 24 03:57:56.333915 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Identity-Status: Confirmed Aug 24 03:57:56.333915 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Is-Admin-Project: True Aug 24 03:57:56.333915 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Id: default Aug 24 03:57:56.333915 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Name: Default Aug 24 03:57:56.333915 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Id: 63408551e1b24a86b8f0059f1a948896 Aug 24 03:57:56.333915 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-496383813 Aug 24 03:57:56.333915 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Role: member,reader Aug 24 03:57:56.333915 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Roles: member,reader Aug 24 03:57:56.336365 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/63408551e1b24a86b8f0059f1a948896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/63408551e1b24a86b8f0059f1a948896"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/63408551e1b24a86b8f0059f1a948896"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_63408551e1b24a86b8f0059f1a948896", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:57:56.336365 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant: tempest-ServerRescueNegativeTestJSON-496383813 Aug 24 03:57:56.336365 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Id: 63408551e1b24a86b8f0059f1a948896 Aug 24 03:57:56.336365 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-496383813 Aug 24 03:57:56.336365 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User: tempest-ServerRescueNegativeTestJSON-496383813-project Aug 24 03:57:56.336365 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Id: default Aug 24 03:57:56.336365 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Name: Default Aug 24 03:57:56.336365 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Id: 547bce0d8133462c95bcb6f272776a27 Aug 24 03:57:56.336365 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Name: tempest-ServerRescueNegativeTestJSON-496383813-project Aug 24 03:57:56.336365 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: method: > Aug 24 03:57:56.336365 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: exception: Instance 9b3eb1f1-0fc7-492c-9fba-02f817e5614c could not be found. Aug 24 03:57:56.336365 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: action_args: {'id': '9b3eb1f1-0fc7-492c-9fba-02f817e5614c'} Aug 24 03:57:56.337268 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:57:56.337268 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:56.337268 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:57:56.337268 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:57:56.337268 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:57:56.337268 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:57:56.337268 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:57:56.337268 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:57:56.337268 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:57:56.337268 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:57:56.337268 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b3eb1f1-0fc7-492c-9fba-02f817e5614c could not be found. Aug 24 03:57:56.337268 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:57:56.337268 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:56.337268 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:57:56.337268 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:56.337268 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:56.337268 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:56.337268 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:57:56.337268 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:57:56.337268 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:57:56.338768 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:57:56.338768 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:57:56.338768 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:57:56.338768 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:57:56.338768 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:57:56.338768 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:57:56.338768 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:57:56.338768 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b3eb1f1-0fc7-492c-9fba-02f817e5614c could not be found. Aug 24 03:57:56.338768 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:57:56.338768 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:56.338768 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:57:56.338768 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:56.338768 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:56.338768 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:56.338768 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:57:56.338768 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:57:56.338768 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b3eb1f1-0fc7-492c-9fba-02f817e5614c could not be found. Aug 24 03:57:56.338768 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:57:56.340247 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-3eb1f774-466f-4788-901d-4d77ffe316ca tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Returning 404 to user: Instance 9b3eb1f1-0fc7-492c-9fba-02f817e5614c could not be found. {{(pid=127869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:57:56.340247 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-3eb1f774-466f-4788-901d-4d77ffe316ca tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c" status: 404 len: 111 microversion: 2.1 time: 0.034129 Aug 24 03:57:56.340247 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 362/730] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:56 2022] GET /compute/v2.1/servers/9b3eb1f1-0fc7-492c-9fba-02f817e5614c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:57:56.344668 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-09f48c50-94d4-41ec-a71d-0772d1120a69 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:56.345163 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-09f48c50-94d4-41ec-a71d-0772d1120a69 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 13f1df4b-056e-4637-a0ec-54f6f78c8730] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:56.351853 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09f48c50-94d4-41ec-a71d-0772d1120a69 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:56.352344 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09f48c50-94d4-41ec-a71d-0772d1120a69 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:56.352882 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09f48c50-94d4-41ec-a71d-0772d1120a69 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:56.353582 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09f48c50-94d4-41ec-a71d-0772d1120a69 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:56.354036 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09f48c50-94d4-41ec-a71d-0772d1120a69 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:56.354457 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09f48c50-94d4-41ec-a71d-0772d1120a69 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:56.379269 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-09f48c50-94d4-41ec-a71d-0772d1120a69 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 13f1df4b-056e-4637-a0ec-54f6f78c8730] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:57:56.528496 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-6ead2f36-36a3-4f97-82c8-21774569db13 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:56.529024 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-6ead2f36-36a3-4f97-82c8-21774569db13 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 0109332f-80ab-4d03-ba4d-1a24fc88fcf1] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:56.535084 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6ead2f36-36a3-4f97-82c8-21774569db13 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:56.535569 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6ead2f36-36a3-4f97-82c8-21774569db13 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:56.536559 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6ead2f36-36a3-4f97-82c8-21774569db13 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:56.537265 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6ead2f36-36a3-4f97-82c8-21774569db13 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:56.537720 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6ead2f36-36a3-4f97-82c8-21774569db13 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:56.538145 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6ead2f36-36a3-4f97-82c8-21774569db13 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:56.551551 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.wsgi [None req-6ead2f36-36a3-4f97-82c8-21774569db13 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] HTTP exception thrown: Instance 0109332f-80ab-4d03-ba4d-1a24fc88fcf1 could not be found. Aug 24 03:57:56.553628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-6ead2f36-36a3-4f97-82c8-21774569db13 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Request method failure captured: Aug 24 03:57:56.553628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: request: GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1 HTTP/1.1 Aug 24 03:57:56.553628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept: application/json Aug 24 03:57:56.553628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept-Encoding: identity Aug 24 03:57:56.553628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Connection: close Aug 24 03:57:56.553628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Length: 0 Aug 24 03:57:56.553628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Type: application/json Aug 24 03:57:56.553628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Host: 10.222.0.82 Aug 24 03:57:56.553628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Openstack-System-Scope: None Aug 24 03:57:56.553628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: User-Agent: python-urllib3/1.26.11 Aug 24 03:57:56.553628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Auth-Token: gAAAAABjBaByYUQ7dP595ip40_OJ_0ufC71Rc-FPYS4vZXmmx4Fislhg9iz6FfvLLHiwJ4Ed0bFNDX6fhqS1zmk_A3EKqVLHT9Pz2gZaaIcE0OalzJoOw2sqfwO-7iDYasbxHIEhvzvTJNavoRaspbu_b6_R5EZ70Pa8SKRgBtFA8vqfpAdszSk Aug 24 03:57:56.553628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Id: None Aug 24 03:57:56.553628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Name: None Aug 24 03:57:56.553628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Identity-Status: Confirmed Aug 24 03:57:56.553628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Is-Admin-Project: True Aug 24 03:57:56.553628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Id: default Aug 24 03:57:56.553628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Name: Default Aug 24 03:57:56.553628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Id: 46ef5b02d8da4d2eac26b6ccfb35e1a4 Aug 24 03:57:56.553628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Name: tempest-AttachVolumeNegativeTest-477133645 Aug 24 03:57:56.553628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Role: member,reader Aug 24 03:57:56.553628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Roles: member,reader Aug 24 03:57:56.555266 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/46ef5b02d8da4d2eac26b6ccfb35e1a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/46ef5b02d8da4d2eac26b6ccfb35e1a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/46ef5b02d8da4d2eac26b6ccfb35e1a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_46ef5b02d8da4d2eac26b6ccfb35e1a4", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:57:56.555266 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant: tempest-AttachVolumeNegativeTest-477133645 Aug 24 03:57:56.555266 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Id: 46ef5b02d8da4d2eac26b6ccfb35e1a4 Aug 24 03:57:56.555266 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-477133645 Aug 24 03:57:56.555266 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User: tempest-AttachVolumeNegativeTest-477133645-project Aug 24 03:57:56.555266 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Id: default Aug 24 03:57:56.555266 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Name: Default Aug 24 03:57:56.555266 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Id: e5582d10ebef459084fe287c18568f98 Aug 24 03:57:56.555266 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Name: tempest-AttachVolumeNegativeTest-477133645-project Aug 24 03:57:56.555266 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: method: > Aug 24 03:57:56.555266 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: exception: Instance 0109332f-80ab-4d03-ba4d-1a24fc88fcf1 could not be found. Aug 24 03:57:56.555266 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: action_args: {'id': '0109332f-80ab-4d03-ba4d-1a24fc88fcf1'} Aug 24 03:57:56.556184 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:57:56.556184 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:56.556184 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:57:56.556184 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:57:56.556184 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:57:56.556184 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:57:56.556184 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:57:56.556184 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:57:56.556184 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:57:56.556184 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:57:56.556184 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0109332f-80ab-4d03-ba4d-1a24fc88fcf1 could not be found. Aug 24 03:57:56.556184 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:57:56.556184 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:56.556184 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:57:56.556184 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:56.556184 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:56.556184 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:56.556184 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:57:56.556184 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:57:56.556184 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:57:56.557714 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:57:56.557714 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:57:56.557714 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:57:56.557714 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:57:56.557714 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:57:56.557714 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:57:56.557714 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:57:56.557714 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0109332f-80ab-4d03-ba4d-1a24fc88fcf1 could not be found. Aug 24 03:57:56.557714 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:57:56.557714 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:56.557714 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:57:56.557714 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:56.557714 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:56.557714 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:56.557714 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:57:56.557714 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:57:56.557714 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0109332f-80ab-4d03-ba4d-1a24fc88fcf1 could not be found. Aug 24 03:57:56.557714 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:57:56.559020 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-6ead2f36-36a3-4f97-82c8-21774569db13 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Returning 404 to user: Instance 0109332f-80ab-4d03-ba4d-1a24fc88fcf1 could not be found. {{(pid=127869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:57:56.559020 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-6ead2f36-36a3-4f97-82c8-21774569db13 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1" status: 404 len: 111 microversion: 2.1 time: 0.030781 Aug 24 03:57:56.559020 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 363/731] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:56 2022] GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:57:56.568189 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-b0582740-5348-4331-af7d-af7e8d300637 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '.version_select at 0x7f15541d0c10>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:56.743610 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-b0582740-5348-4331-af7d-af7e8d300637 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-696726489" status: 202 len: 0 microversion: 2.1 time: 0.179566 Aug 24 03:57:56.744178 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 364/732] 10.222.0.82 () {58 vars in 1218 bytes} [Wed Aug 24 03:57:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-696726489 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:57:56.770055 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-09f48c50-94d4-41ec-a71d-0772d1120a69 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "DELETE /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730" status: 204 len: 0 microversion: 2.1 time: 0.429170 Aug 24 03:57:56.770745 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 369/733] 10.222.0.82 () {58 vars in 1239 bytes} [Wed Aug 24 03:57:56 2022] DELETE /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:57:56.781367 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-f2e9186e-7ecf-4058-9bd8-2d411b22682b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:56.781918 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-f2e9186e-7ecf-4058-9bd8-2d411b22682b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 13f1df4b-056e-4637-a0ec-54f6f78c8730] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:56.789163 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f2e9186e-7ecf-4058-9bd8-2d411b22682b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:56.790500 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f2e9186e-7ecf-4058-9bd8-2d411b22682b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:56.790500 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f2e9186e-7ecf-4058-9bd8-2d411b22682b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:56.793164 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f2e9186e-7ecf-4058-9bd8-2d411b22682b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:56.793164 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f2e9186e-7ecf-4058-9bd8-2d411b22682b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:56.798124 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f2e9186e-7ecf-4058-9bd8-2d411b22682b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:56.962321 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-f2e9186e-7ecf-4058-9bd8-2d411b22682b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:56.971682 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-f2e9186e-7ecf-4058-9bd8-2d411b22682b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730" status: 200 len: 1521 microversion: 2.1 time: 0.195178 Aug 24 03:57:56.972252 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 365/734] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:56 2022] GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:57.338498 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-effa5bd0-5324-477a-b76c-11aac6190397 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:57.339266 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-effa5bd0-5324-477a-b76c-11aac6190397 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:57.345557 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-effa5bd0-5324-477a-b76c-11aac6190397 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:57.346056 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-effa5bd0-5324-477a-b76c-11aac6190397 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:57.346493 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-effa5bd0-5324-477a-b76c-11aac6190397 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:57.347215 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-effa5bd0-5324-477a-b76c-11aac6190397 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:57.347680 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-effa5bd0-5324-477a-b76c-11aac6190397 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:57.350122 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-effa5bd0-5324-477a-b76c-11aac6190397 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:57.486028 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-effa5bd0-5324-477a-b76c-11aac6190397 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:57.494543 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-effa5bd0-5324-477a-b76c-11aac6190397 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:57.496061 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-effa5bd0-5324-477a-b76c-11aac6190397 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:57.497282 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-effa5bd0-5324-477a-b76c-11aac6190397 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1724 microversion: 2.20 time: 0.163157 Aug 24 03:57:57.497843 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 370/735] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:57 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:57:57.602428 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-99041c9c-5176-4439-be64-44d447edf85e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Action: 'create', calling method: .version_select at 0x7f15541d08b0>, body: {"keypair": {"name": "tempest-keypair-1149729991", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFMzI4mXDbM6GQOD0ctfHggbLPTKOL8kizgs1JzEkxQVQW8TMrgN4J5MI+J+uPlnCeTOCGFLxkPyV5F2sWIX561aTCMCZo16/Q6iTbd34a0XKzoO49LRsYh62hSXV0MpA=="}} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:57.618339 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.quota [None req-99041c9c-5176-4439-be64-44d447edf85e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Getting quotas for project 46ef5b02d8da4d2eac26b6ccfb35e1a4. Resources: {'key_pairs'} {{(pid=127869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:57:57.622167 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.quota [None req-99041c9c-5176-4439-be64-44d447edf85e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Getting quotas for user e5582d10ebef459084fe287c18568f98 and project 46ef5b02d8da4d2eac26b6ccfb35e1a4. Resources: {'key_pairs'} {{(pid=127869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:57:57.691188 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-99041c9c-5176-4439-be64-44d447edf85e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.093588 Aug 24 03:57:57.691862 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 366/736] 10.222.0.82 () {60 vars in 1159 bytes} [Wed Aug 24 03:57:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:57.994419 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e9fb7970-05be-4774-b2fd-7b5c0c8005b3 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:57.995108 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e9fb7970-05be-4774-b2fd-7b5c0c8005b3 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 13f1df4b-056e-4637-a0ec-54f6f78c8730] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:58.001053 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e9fb7970-05be-4774-b2fd-7b5c0c8005b3 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:58.002198 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e9fb7970-05be-4774-b2fd-7b5c0c8005b3 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:58.002685 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e9fb7970-05be-4774-b2fd-7b5c0c8005b3 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:58.003412 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e9fb7970-05be-4774-b2fd-7b5c0c8005b3 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:58.003874 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e9fb7970-05be-4774-b2fd-7b5c0c8005b3 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:58.004300 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e9fb7970-05be-4774-b2fd-7b5c0c8005b3 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:58.157642 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-e9fb7970-05be-4774-b2fd-7b5c0c8005b3 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:58.165462 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e9fb7970-05be-4774-b2fd-7b5c0c8005b3 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730" status: 200 len: 1521 microversion: 2.1 time: 0.174997 Aug 24 03:57:58.166023 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 371/737] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:57 2022] GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:58.520407 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-61023677-758d-441f-9a42-da3991762301 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:58.521029 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-61023677-758d-441f-9a42-da3991762301 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:58.527073 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-61023677-758d-441f-9a42-da3991762301 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:58.527558 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-61023677-758d-441f-9a42-da3991762301 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:58.527995 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-61023677-758d-441f-9a42-da3991762301 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:58.528685 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-61023677-758d-441f-9a42-da3991762301 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:58.529139 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-61023677-758d-441f-9a42-da3991762301 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:58.529560 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-61023677-758d-441f-9a42-da3991762301 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:58.662798 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-61023677-758d-441f-9a42-da3991762301 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:58.670966 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-61023677-758d-441f-9a42-da3991762301 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:58.674372 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-61023677-758d-441f-9a42-da3991762301 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:58.674372 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-61023677-758d-441f-9a42-da3991762301 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1724 microversion: 2.20 time: 0.157285 Aug 24 03:57:58.674372 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 367/738] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:58 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:57:59.187144 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7ddf768b-f2d8-4334-a3ec-4fd91d677c06 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:59.187781 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7ddf768b-f2d8-4334-a3ec-4fd91d677c06 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 13f1df4b-056e-4637-a0ec-54f6f78c8730] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:59.194833 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ddf768b-f2d8-4334-a3ec-4fd91d677c06 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:59.195319 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ddf768b-f2d8-4334-a3ec-4fd91d677c06 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:59.195754 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ddf768b-f2d8-4334-a3ec-4fd91d677c06 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:59.196447 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ddf768b-f2d8-4334-a3ec-4fd91d677c06 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:59.196929 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ddf768b-f2d8-4334-a3ec-4fd91d677c06 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:59.197352 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ddf768b-f2d8-4334-a3ec-4fd91d677c06 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:59.330489 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-7ddf768b-f2d8-4334-a3ec-4fd91d677c06 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:59.339725 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7ddf768b-f2d8-4334-a3ec-4fd91d677c06 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730" status: 200 len: 1521 microversion: 2.1 time: 0.156434 Aug 24 03:57:59.340312 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 372/739] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:59 2022] GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:59.698684 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-df636a9d-d4b0-4e92-8de0-db86d3f0a466 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:59.699296 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-df636a9d-d4b0-4e92-8de0-db86d3f0a466 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:59.701678 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:59.706407 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-df636a9d-d4b0-4e92-8de0-db86d3f0a466 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:59.709181 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-df636a9d-d4b0-4e92-8de0-db86d3f0a466 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:59.709181 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-df636a9d-d4b0-4e92-8de0-db86d3f0a466 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:59.709181 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-df636a9d-d4b0-4e92-8de0-db86d3f0a466 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:59.709181 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-df636a9d-d4b0-4e92-8de0-db86d3f0a466 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:59.709545 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-df636a9d-d4b0-4e92-8de0-db86d3f0a466 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:59.959802 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-df636a9d-d4b0-4e92-8de0-db86d3f0a466 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:59.968763 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-df636a9d-d4b0-4e92-8de0-db86d3f0a466 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:59.970265 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-df636a9d-d4b0-4e92-8de0-db86d3f0a466 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:59.975415 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-df636a9d-d4b0-4e92-8de0-db86d3f0a466 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1724 microversion: 2.20 time: 0.277421 Aug 24 03:57:59.975415 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 368/740] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:59 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1724 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:00.247740 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-6b4e4abc-40bd-46af-a3de-6f06334eaaa2 req-d91e491c-1ba5-45b1-a768-ec4ed06af7cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13f1df4b-056e-4637-a0ec-54f6f78c8730", "name": "network-vif-deleted", "tag": "033aff9c-871d-43e1-8321-7f6d1b63cadb"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:00.261672 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-6b4e4abc-40bd-46af-a3de-6f06334eaaa2 req-d91e491c-1ba5-45b1-a768-ec4ed06af7cf service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:00.261672 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-6b4e4abc-40bd-46af-a3de-6f06334eaaa2 req-d91e491c-1ba5-45b1-a768-ec4ed06af7cf service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:00.261672 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-6b4e4abc-40bd-46af-a3de-6f06334eaaa2 req-d91e491c-1ba5-45b1-a768-ec4ed06af7cf service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:00.273532 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-6b4e4abc-40bd-46af-a3de-6f06334eaaa2 req-d91e491c-1ba5-45b1-a768-ec4ed06af7cf service nova] Creating event network-vif-deleted:033aff9c-871d-43e1-8321-7f6d1b63cadb for instance 13f1df4b-056e-4637-a0ec-54f6f78c8730 on hv-cinder-85426 Aug 24 03:58:00.278938 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-6b4e4abc-40bd-46af-a3de-6f06334eaaa2 req-d91e491c-1ba5-45b1-a768-ec4ed06af7cf service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034843 Aug 24 03:58:00.279536 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 373/741] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:00.361480 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-30e4002e-7959-4a8f-9926-28b31968749b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:00.362083 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-30e4002e-7959-4a8f-9926-28b31968749b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 13f1df4b-056e-4637-a0ec-54f6f78c8730] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:00.368373 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-30e4002e-7959-4a8f-9926-28b31968749b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:00.369839 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-30e4002e-7959-4a8f-9926-28b31968749b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:00.370268 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-30e4002e-7959-4a8f-9926-28b31968749b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:00.371022 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-30e4002e-7959-4a8f-9926-28b31968749b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:00.375104 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-30e4002e-7959-4a8f-9926-28b31968749b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:00.375104 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-30e4002e-7959-4a8f-9926-28b31968749b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:00.436780 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-30e4002e-7959-4a8f-9926-28b31968749b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547bce0d8133462c95bcb6f272776a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63408551e1b24a86b8f0059f1a948896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:00.444492 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-30e4002e-7959-4a8f-9926-28b31968749b tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730" status: 200 len: 1479 microversion: 2.1 time: 0.087837 Aug 24 03:58:00.445117 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 369/742] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:00 2022] GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730 => generated 1479 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:00.558894 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-fb79752e-9fb0-4fb7-bc51-58f9386bc902 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1818144659", "imageRef": "c32522f7-22a8-45d4-a51e-f17637def2e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "35aecb0c-8d69-4fb0-8c17-38cb8c49008a"}], "security_groups": [{"name": "tempest-securitygroup--1957581233"}], "key_name": "tempest-keypair-1149729991", "user_data": "}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:00.668767 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-fb79752e-9fb0-4fb7-bc51-58f9386bc902 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] validate_networks() for [('35aecb0c-8d69-4fb0-8c17-38cb8c49008a', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:58:00.994323 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-6ec0fd7c-a3a1-4425-a20a-ffafc69f163f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:00.994978 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-6ec0fd7c-a3a1-4425-a20a-ffafc69f163f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:01.009331 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6ec0fd7c-a3a1-4425-a20a-ffafc69f163f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:01.010074 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6ec0fd7c-a3a1-4425-a20a-ffafc69f163f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:01.010620 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6ec0fd7c-a3a1-4425-a20a-ffafc69f163f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:01.011344 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6ec0fd7c-a3a1-4425-a20a-ffafc69f163f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:01.011806 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6ec0fd7c-a3a1-4425-a20a-ffafc69f163f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:01.012221 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6ec0fd7c-a3a1-4425-a20a-ffafc69f163f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:01.048344 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-fb79752e-9fb0-4fb7-bc51-58f9386bc902 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:58:01.048764 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-fb79752e-9fb0-4fb7-bc51-58f9386bc902 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:58:01.049234 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-fb79752e-9fb0-4fb7-bc51-58f9386bc902 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:58:01.049642 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-fb79752e-9fb0-4fb7-bc51-58f9386bc902 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:58:01.050053 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-fb79752e-9fb0-4fb7-bc51-58f9386bc902 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:58:01.059848 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fb79752e-9fb0-4fb7-bc51-58f9386bc902 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:01.062158 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fb79752e-9fb0-4fb7-bc51-58f9386bc902 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:01.062158 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fb79752e-9fb0-4fb7-bc51-58f9386bc902 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:01.062158 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fb79752e-9fb0-4fb7-bc51-58f9386bc902 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:01.062158 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fb79752e-9fb0-4fb7-bc51-58f9386bc902 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:01.063105 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-fb79752e-9fb0-4fb7-bc51-58f9386bc902 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:01.082171 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.quota [None req-fb79752e-9fb0-4fb7-bc51-58f9386bc902 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Getting quotas for project 46ef5b02d8da4d2eac26b6ccfb35e1a4. Resources: {'instances', 'cores', 'ram'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:58:01.087570 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.quota [None req-fb79752e-9fb0-4fb7-bc51-58f9386bc902 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Getting quotas for user e5582d10ebef459084fe287c18568f98 and project 46ef5b02d8da4d2eac26b6ccfb35e1a4. Resources: {'instances', 'cores', 'ram'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:58:01.099562 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fb79752e-9fb0-4fb7-bc51-58f9386bc902 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:58:01.101968 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-fb79752e-9fb0-4fb7-bc51-58f9386bc902 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 66dd80a8-8e33-421c-9c4a-200ad720823a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c32522f7-22a8-45d4-a51e-f17637def2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:58:01.151811 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-6ec0fd7c-a3a1-4425-a20a-ffafc69f163f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:01.160039 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-6ec0fd7c-a3a1-4425-a20a-ffafc69f163f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:01.161706 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-6ec0fd7c-a3a1-4425-a20a-ffafc69f163f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:01.163018 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-6ec0fd7c-a3a1-4425-a20a-ffafc69f163f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1724 microversion: 2.20 time: 0.172909 Aug 24 03:58:01.163575 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 370/743] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:00 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:58:01.264427 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-fb79752e-9fb0-4fb7-bc51-58f9386bc902 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.709920 Aug 24 03:58:01.267469 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 374/744] 10.222.0.82 () {60 vars in 1147 bytes} [Wed Aug 24 03:58:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:58:01.278618 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-a1aa5ce4-d365-463a-be37-dc8e59dd1207 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:01.279239 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-a1aa5ce4-d365-463a-be37-dc8e59dd1207 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 66dd80a8-8e33-421c-9c4a-200ad720823a] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:01.340408 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-a1aa5ce4-d365-463a-be37-dc8e59dd1207 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:01.347183 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-a1aa5ce4-d365-463a-be37-dc8e59dd1207 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a" status: 200 len: 1242 microversion: 2.1 time: 0.074355 Aug 24 03:58:01.347751 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 371/745] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:01 2022] GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a => generated 1242 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:01.465489 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1f439d5f-3bff-49b5-80fc-8c6c33dc6615 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:01.466153 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1f439d5f-3bff-49b5-80fc-8c6c33dc6615 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] [instance: 13f1df4b-056e-4637-a0ec-54f6f78c8730] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:01.472555 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1f439d5f-3bff-49b5-80fc-8c6c33dc6615 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:01.473597 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1f439d5f-3bff-49b5-80fc-8c6c33dc6615 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:01.483026 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1f439d5f-3bff-49b5-80fc-8c6c33dc6615 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:01.483026 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1f439d5f-3bff-49b5-80fc-8c6c33dc6615 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:01.483026 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1f439d5f-3bff-49b5-80fc-8c6c33dc6615 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:01.483026 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1f439d5f-3bff-49b5-80fc-8c6c33dc6615 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:01.489349 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-1f439d5f-3bff-49b5-80fc-8c6c33dc6615 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] HTTP exception thrown: Instance 13f1df4b-056e-4637-a0ec-54f6f78c8730 could not be found. Aug 24 03:58:01.491010 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1f439d5f-3bff-49b5-80fc-8c6c33dc6615 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Request method failure captured: Aug 24 03:58:01.491010 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730 HTTP/1.1 Aug 24 03:58:01.491010 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept: application/json Aug 24 03:58:01.491010 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept-Encoding: identity Aug 24 03:58:01.491010 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Connection: close Aug 24 03:58:01.491010 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Length: 0 Aug 24 03:58:01.491010 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Type: application/json Aug 24 03:58:01.491010 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Host: 10.222.0.82 Aug 24 03:58:01.491010 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Openstack-System-Scope: None Aug 24 03:58:01.491010 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.11 Aug 24 03:58:01.491010 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Auth-Token: gAAAAABjBaBwfFwtOW_HqduVs-Y72_nB0AfAGPkKiTC3c4uSLXKyBQUeIsdjnKcKqOXOXGzaPm3531c8BOjXNm1ZmlI5tsEEAgDjb8e71EXHI4eXRLl99FfDJSPPx9GmrFEVoPYMPEhZvpFFVWFOIsIGclHl28xUAF2supcEcrqrvkfNAW9RaN4 Aug 24 03:58:01.491010 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Id: None Aug 24 03:58:01.491010 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Name: None Aug 24 03:58:01.491010 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Identity-Status: Confirmed Aug 24 03:58:01.491010 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Is-Admin-Project: True Aug 24 03:58:01.491010 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Id: default Aug 24 03:58:01.491010 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Name: Default Aug 24 03:58:01.491010 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Id: 63408551e1b24a86b8f0059f1a948896 Aug 24 03:58:01.491010 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-496383813 Aug 24 03:58:01.491010 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Role: member,reader Aug 24 03:58:01.491010 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Roles: member,reader Aug 24 03:58:01.492597 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/63408551e1b24a86b8f0059f1a948896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/63408551e1b24a86b8f0059f1a948896"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/63408551e1b24a86b8f0059f1a948896"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_63408551e1b24a86b8f0059f1a948896", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:58:01.492597 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant: tempest-ServerRescueNegativeTestJSON-496383813 Aug 24 03:58:01.492597 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Id: 63408551e1b24a86b8f0059f1a948896 Aug 24 03:58:01.492597 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-496383813 Aug 24 03:58:01.492597 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User: tempest-ServerRescueNegativeTestJSON-496383813-project Aug 24 03:58:01.492597 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Id: default Aug 24 03:58:01.492597 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Name: Default Aug 24 03:58:01.492597 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Id: 547bce0d8133462c95bcb6f272776a27 Aug 24 03:58:01.492597 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Name: tempest-ServerRescueNegativeTestJSON-496383813-project Aug 24 03:58:01.492597 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: method: > Aug 24 03:58:01.492597 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: exception: Instance 13f1df4b-056e-4637-a0ec-54f6f78c8730 could not be found. Aug 24 03:58:01.492597 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: action_args: {'id': '13f1df4b-056e-4637-a0ec-54f6f78c8730'} Aug 24 03:58:01.493623 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:58:01.493623 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:58:01.493623 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:58:01.493623 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:58:01.493623 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:58:01.493623 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:58:01.493623 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:58:01.493623 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:58:01.493623 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:58:01.493623 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:58:01.493623 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13f1df4b-056e-4637-a0ec-54f6f78c8730 could not be found. Aug 24 03:58:01.493623 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:58:01.493623 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:58:01.493623 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:58:01.493623 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:58:01.493623 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:58:01.493623 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:58:01.493623 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:58:01.493623 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:58:01.493623 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:58:01.495009 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:58:01.495009 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:58:01.495009 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:58:01.495009 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:58:01.495009 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:58:01.495009 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:58:01.495009 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:58:01.495009 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13f1df4b-056e-4637-a0ec-54f6f78c8730 could not be found. Aug 24 03:58:01.495009 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:58:01.495009 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:58:01.495009 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:58:01.495009 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:58:01.495009 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:58:01.495009 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:58:01.495009 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:58:01.495009 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:58:01.495009 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13f1df4b-056e-4637-a0ec-54f6f78c8730 could not be found. Aug 24 03:58:01.495009 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:58:01.496251 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1f439d5f-3bff-49b5-80fc-8c6c33dc6615 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] Returning 404 to user: Instance 13f1df4b-056e-4637-a0ec-54f6f78c8730 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:58:01.496251 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1f439d5f-3bff-49b5-80fc-8c6c33dc6615 tempest-ServerRescueNegativeTestJSON-496383813 tempest-ServerRescueNegativeTestJSON-496383813-project] 10.222.0.82 "GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730" status: 404 len: 111 microversion: 2.1 time: 0.031065 Aug 24 03:58:01.496251 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 375/746] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:01 2022] GET /compute/v2.1/servers/13f1df4b-056e-4637-a0ec-54f6f78c8730 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:58:02.186944 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-d443eab5-69b4-44dd-a6c4-77a245523ecd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:02.187552 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-d443eab5-69b4-44dd-a6c4-77a245523ecd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:02.194795 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d443eab5-69b4-44dd-a6c4-77a245523ecd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:02.195277 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d443eab5-69b4-44dd-a6c4-77a245523ecd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:02.195806 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d443eab5-69b4-44dd-a6c4-77a245523ecd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:02.196506 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d443eab5-69b4-44dd-a6c4-77a245523ecd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:02.196949 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d443eab5-69b4-44dd-a6c4-77a245523ecd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:02.197366 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d443eab5-69b4-44dd-a6c4-77a245523ecd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:02.368397 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-754ed146-fb1d-4eda-9e6e-1f0f692bd613 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:02.369384 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-754ed146-fb1d-4eda-9e6e-1f0f692bd613 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 66dd80a8-8e33-421c-9c4a-200ad720823a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:02.386081 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-754ed146-fb1d-4eda-9e6e-1f0f692bd613 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:02.387492 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-754ed146-fb1d-4eda-9e6e-1f0f692bd613 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:02.387927 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-754ed146-fb1d-4eda-9e6e-1f0f692bd613 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:02.388630 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-754ed146-fb1d-4eda-9e6e-1f0f692bd613 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:02.389125 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-754ed146-fb1d-4eda-9e6e-1f0f692bd613 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:02.389485 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-754ed146-fb1d-4eda-9e6e-1f0f692bd613 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:02.439266 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-d443eab5-69b4-44dd-a6c4-77a245523ecd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:02.458797 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-d443eab5-69b4-44dd-a6c4-77a245523ecd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:02.460857 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-d443eab5-69b4-44dd-a6c4-77a245523ecd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:02.462237 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-d443eab5-69b4-44dd-a6c4-77a245523ecd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1724 microversion: 2.20 time: 0.279576 Aug 24 03:58:02.462822 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 372/747] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:02 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1724 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:02.477779 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-754ed146-fb1d-4eda-9e6e-1f0f692bd613 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:02.489307 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-754ed146-fb1d-4eda-9e6e-1f0f692bd613 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a" status: 200 len: 1246 microversion: 2.1 time: 0.124628 Aug 24 03:58:02.490195 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 376/748] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:02 2022] GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a => generated 1246 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:03.486357 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-9810cad5-f9de-40ee-8923-8fba5ff2feb9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:03.487654 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-9810cad5-f9de-40ee-8923-8fba5ff2feb9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:03.502195 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9810cad5-f9de-40ee-8923-8fba5ff2feb9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:03.502873 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9810cad5-f9de-40ee-8923-8fba5ff2feb9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:03.503323 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9810cad5-f9de-40ee-8923-8fba5ff2feb9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:03.504112 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9810cad5-f9de-40ee-8923-8fba5ff2feb9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:03.504574 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9810cad5-f9de-40ee-8923-8fba5ff2feb9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:03.506148 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9810cad5-f9de-40ee-8923-8fba5ff2feb9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:03.515147 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-045951b9-cf6f-4541-8b63-b43b346253a7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:03.515813 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-045951b9-cf6f-4541-8b63-b43b346253a7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 66dd80a8-8e33-421c-9c4a-200ad720823a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:03.527324 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-045951b9-cf6f-4541-8b63-b43b346253a7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:03.528347 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-045951b9-cf6f-4541-8b63-b43b346253a7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:03.530703 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-045951b9-cf6f-4541-8b63-b43b346253a7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:03.532363 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-045951b9-cf6f-4541-8b63-b43b346253a7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:03.533206 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-045951b9-cf6f-4541-8b63-b43b346253a7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:03.534714 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-045951b9-cf6f-4541-8b63-b43b346253a7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:03.647768 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-045951b9-cf6f-4541-8b63-b43b346253a7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:03.647768 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-045951b9-cf6f-4541-8b63-b43b346253a7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a" status: 200 len: 1302 microversion: 2.1 time: 0.134309 Aug 24 03:58:03.647768 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 377/749] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:03 2022] GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a => generated 1302 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:03.815537 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-9810cad5-f9de-40ee-8923-8fba5ff2feb9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:03.825637 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-9810cad5-f9de-40ee-8923-8fba5ff2feb9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:03.827651 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-9810cad5-f9de-40ee-8923-8fba5ff2feb9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:03.829066 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-9810cad5-f9de-40ee-8923-8fba5ff2feb9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1724 microversion: 2.20 time: 0.346888 Aug 24 03:58:03.830896 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 373/750] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:03 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1724 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:04.666642 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2da56b9c-15ae-4146-9bbc-85fa0ede1907 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:04.667969 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2da56b9c-15ae-4146-9bbc-85fa0ede1907 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 66dd80a8-8e33-421c-9c4a-200ad720823a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:04.675144 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2da56b9c-15ae-4146-9bbc-85fa0ede1907 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:04.675621 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2da56b9c-15ae-4146-9bbc-85fa0ede1907 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:04.676885 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2da56b9c-15ae-4146-9bbc-85fa0ede1907 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:04.677821 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2da56b9c-15ae-4146-9bbc-85fa0ede1907 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:04.678159 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2da56b9c-15ae-4146-9bbc-85fa0ede1907 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:04.678608 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2da56b9c-15ae-4146-9bbc-85fa0ede1907 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:04.746667 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-2da56b9c-15ae-4146-9bbc-85fa0ede1907 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:04.757932 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2da56b9c-15ae-4146-9bbc-85fa0ede1907 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a" status: 200 len: 1300 microversion: 2.1 time: 0.095246 Aug 24 03:58:04.758862 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 378/751] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:04 2022] GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a => generated 1300 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:04.853987 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-77c421d4-0e49-4609-b382-82007ea8abc0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:04.854684 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-77c421d4-0e49-4609-b382-82007ea8abc0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:04.861366 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-77c421d4-0e49-4609-b382-82007ea8abc0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:04.861785 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-77c421d4-0e49-4609-b382-82007ea8abc0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:04.862229 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-77c421d4-0e49-4609-b382-82007ea8abc0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:04.862934 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-77c421d4-0e49-4609-b382-82007ea8abc0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:04.863435 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-77c421d4-0e49-4609-b382-82007ea8abc0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:04.864207 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-77c421d4-0e49-4609-b382-82007ea8abc0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:05.133976 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-77c421d4-0e49-4609-b382-82007ea8abc0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:05.146754 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-77c421d4-0e49-4609-b382-82007ea8abc0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:05.148446 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-77c421d4-0e49-4609-b382-82007ea8abc0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:05.149802 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-77c421d4-0e49-4609-b382-82007ea8abc0 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1724 microversion: 2.20 time: 0.299847 Aug 24 03:58:05.150449 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 374/752] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:04 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1724 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:05.787826 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-156e19df-8cd8-4d8b-8fe0-5e37bc52dfd0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:05.788452 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-156e19df-8cd8-4d8b-8fe0-5e37bc52dfd0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 66dd80a8-8e33-421c-9c4a-200ad720823a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:05.797560 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-156e19df-8cd8-4d8b-8fe0-5e37bc52dfd0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:05.798048 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-156e19df-8cd8-4d8b-8fe0-5e37bc52dfd0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:05.799912 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-156e19df-8cd8-4d8b-8fe0-5e37bc52dfd0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:05.802449 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-156e19df-8cd8-4d8b-8fe0-5e37bc52dfd0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:05.802808 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-156e19df-8cd8-4d8b-8fe0-5e37bc52dfd0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:05.803241 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-156e19df-8cd8-4d8b-8fe0-5e37bc52dfd0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:06.040208 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-156e19df-8cd8-4d8b-8fe0-5e37bc52dfd0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:06.054874 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-156e19df-8cd8-4d8b-8fe0-5e37bc52dfd0 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a" status: 200 len: 1368 microversion: 2.1 time: 0.271499 Aug 24 03:58:06.070564 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 379/753] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:05 2022] GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a => generated 1368 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:06.174589 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-33237631-29a6-4944-a6a5-2812d9fc3a9d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:06.175316 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-33237631-29a6-4944-a6a5-2812d9fc3a9d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:06.183999 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-33237631-29a6-4944-a6a5-2812d9fc3a9d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:06.184545 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-33237631-29a6-4944-a6a5-2812d9fc3a9d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:06.185098 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-33237631-29a6-4944-a6a5-2812d9fc3a9d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:06.185909 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-33237631-29a6-4944-a6a5-2812d9fc3a9d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:06.186625 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-33237631-29a6-4944-a6a5-2812d9fc3a9d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:06.187145 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-33237631-29a6-4944-a6a5-2812d9fc3a9d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:06.314934 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-c3e8cc8b-158e-4793-8f2b-a9aed102777c req-20963f3a-a53b-4a6f-8063-e6340f61949d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66dd80a8-8e33-421c-9c4a-200ad720823a", "tag": "84ac01da-84a3-455a-9de0-78bfa8ece981"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:06.328396 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-c3e8cc8b-158e-4793-8f2b-a9aed102777c req-20963f3a-a53b-4a6f-8063-e6340f61949d service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:06.328396 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-c3e8cc8b-158e-4793-8f2b-a9aed102777c req-20963f3a-a53b-4a6f-8063-e6340f61949d service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:06.329056 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-c3e8cc8b-158e-4793-8f2b-a9aed102777c req-20963f3a-a53b-4a6f-8063-e6340f61949d service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:06.351238 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-c3e8cc8b-158e-4793-8f2b-a9aed102777c req-20963f3a-a53b-4a6f-8063-e6340f61949d service nova] Creating event network-changed:84ac01da-84a3-455a-9de0-78bfa8ece981 for instance 66dd80a8-8e33-421c-9c4a-200ad720823a on hv-cinder-85426 Aug 24 03:58:06.357951 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-c3e8cc8b-158e-4793-8f2b-a9aed102777c req-20963f3a-a53b-4a6f-8063-e6340f61949d service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047165 Aug 24 03:58:06.361528 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 380/754] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:58:06.414328 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-33237631-29a6-4944-a6a5-2812d9fc3a9d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:06.423373 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-33237631-29a6-4944-a6a5-2812d9fc3a9d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:06.426757 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-33237631-29a6-4944-a6a5-2812d9fc3a9d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:06.428170 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-33237631-29a6-4944-a6a5-2812d9fc3a9d tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1724 microversion: 2.20 time: 0.258862 Aug 24 03:58:06.428883 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 375/755] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:06 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1724 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:07.078172 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dd86d3f1-9614-4a87-8ac5-e380d7766547 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:07.078900 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-dd86d3f1-9614-4a87-8ac5-e380d7766547 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 66dd80a8-8e33-421c-9c4a-200ad720823a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:07.086698 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dd86d3f1-9614-4a87-8ac5-e380d7766547 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:07.087248 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dd86d3f1-9614-4a87-8ac5-e380d7766547 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:07.087690 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dd86d3f1-9614-4a87-8ac5-e380d7766547 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:07.089007 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dd86d3f1-9614-4a87-8ac5-e380d7766547 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:07.089466 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dd86d3f1-9614-4a87-8ac5-e380d7766547 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:07.089894 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dd86d3f1-9614-4a87-8ac5-e380d7766547 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:07.226954 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-dd86d3f1-9614-4a87-8ac5-e380d7766547 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:07.234990 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-dd86d3f1-9614-4a87-8ac5-e380d7766547 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a" status: 200 len: 1368 microversion: 2.1 time: 0.161439 Aug 24 03:58:07.235801 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 381/756] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:07 2022] GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:07.455661 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-563517b6-24d7-4709-9e42-ebfc9fdf3281 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:07.456472 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-563517b6-24d7-4709-9e42-ebfc9fdf3281 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:07.462961 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-563517b6-24d7-4709-9e42-ebfc9fdf3281 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:07.463450 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-563517b6-24d7-4709-9e42-ebfc9fdf3281 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:07.463877 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-563517b6-24d7-4709-9e42-ebfc9fdf3281 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:07.464559 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-563517b6-24d7-4709-9e42-ebfc9fdf3281 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:07.465010 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-563517b6-24d7-4709-9e42-ebfc9fdf3281 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:07.465430 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-563517b6-24d7-4709-9e42-ebfc9fdf3281 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:07.609894 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-563517b6-24d7-4709-9e42-ebfc9fdf3281 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:07.619193 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-563517b6-24d7-4709-9e42-ebfc9fdf3281 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:07.621849 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-563517b6-24d7-4709-9e42-ebfc9fdf3281 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:07.621849 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-563517b6-24d7-4709-9e42-ebfc9fdf3281 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1724 microversion: 2.20 time: 0.169911 Aug 24 03:58:07.622182 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 376/757] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:07 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:08.215125 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ce6407c0-ce3b-4c7a-800e-850e3a6e7551 tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] Action: 'create', calling method: .version_select at 0x7f15541ce3a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-826031144"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:08.258024 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-d2c94bf5-f667-4128-817f-a4793a569351 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:08.258551 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-d2c94bf5-f667-4128-817f-a4793a569351 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 66dd80a8-8e33-421c-9c4a-200ad720823a] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:08.264582 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d2c94bf5-f667-4128-817f-a4793a569351 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:08.265127 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d2c94bf5-f667-4128-817f-a4793a569351 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:08.265565 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d2c94bf5-f667-4128-817f-a4793a569351 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:08.266286 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d2c94bf5-f667-4128-817f-a4793a569351 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:08.266759 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d2c94bf5-f667-4128-817f-a4793a569351 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:08.267183 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d2c94bf5-f667-4128-817f-a4793a569351 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:08.408606 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-d2c94bf5-f667-4128-817f-a4793a569351 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:08.416657 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-d2c94bf5-f667-4128-817f-a4793a569351 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a" status: 200 len: 1368 microversion: 2.1 time: 0.163894 Aug 24 03:58:08.417225 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 377/758] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:08 2022] GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:58:08.644194 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-b76c7628-1dbe-485f-8483-16e43fbc5295 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:08.644856 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-b76c7628-1dbe-485f-8483-16e43fbc5295 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:08.657685 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b76c7628-1dbe-485f-8483-16e43fbc5295 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:08.657685 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b76c7628-1dbe-485f-8483-16e43fbc5295 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:08.657685 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b76c7628-1dbe-485f-8483-16e43fbc5295 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:08.657685 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b76c7628-1dbe-485f-8483-16e43fbc5295 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:08.658051 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b76c7628-1dbe-485f-8483-16e43fbc5295 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:08.658051 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b76c7628-1dbe-485f-8483-16e43fbc5295 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:08.791366 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-b76c7628-1dbe-485f-8483-16e43fbc5295 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:08.799382 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-b76c7628-1dbe-485f-8483-16e43fbc5295 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:08.800920 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-b76c7628-1dbe-485f-8483-16e43fbc5295 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:08.802731 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-b76c7628-1dbe-485f-8483-16e43fbc5295 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1745 microversion: 2.20 time: 0.162441 Aug 24 03:58:08.803288 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 378/759] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:08 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:58:08.873926 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ce6407c0-ce3b-4c7a-800e-850e3a6e7551 tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] 10.222.0.82 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.773032 Aug 24 03:58:08.874565 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 382/760] 10.222.0.82 () {60 vars in 1155 bytes} [Wed Aug 24 03:58:08 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 774 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 24 03:58:08.887763 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-f84e3b15-b58b-4d7c-8fde-1f16d7440994 tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] Calling method '.version_select at 0x7f155426e040>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:08.937014 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-f84e3b15-b58b-4d7c-8fde-1f16d7440994 tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/cacb89df-a7c8-498e-a630-3f7c47a6ab8e" status: 200 len: 344 microversion: 2.1 time: 0.052942 Aug 24 03:58:08.941198 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 379/761] 10.222.0.82 () {58 vars in 1245 bytes} [Wed Aug 24 03:58:08 2022] GET /compute/v2.1/os-volumes/cacb89df-a7c8-498e-a630-3f7c47a6ab8e => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:09.437104 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f1770ff9-b409-4f2c-a016-ab74c8070cc5 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:09.437709 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f1770ff9-b409-4f2c-a016-ab74c8070cc5 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 66dd80a8-8e33-421c-9c4a-200ad720823a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:09.439704 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:09.445547 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1770ff9-b409-4f2c-a016-ab74c8070cc5 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:09.446027 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1770ff9-b409-4f2c-a016-ab74c8070cc5 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:09.446452 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1770ff9-b409-4f2c-a016-ab74c8070cc5 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:09.447157 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1770ff9-b409-4f2c-a016-ab74c8070cc5 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:09.447603 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1770ff9-b409-4f2c-a016-ab74c8070cc5 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:09.451242 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f1770ff9-b409-4f2c-a016-ab74c8070cc5 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:09.578942 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-f1770ff9-b409-4f2c-a016-ab74c8070cc5 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:09.587575 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f1770ff9-b409-4f2c-a016-ab74c8070cc5 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a" status: 200 len: 1368 microversion: 2.1 time: 0.154784 Aug 24 03:58:09.588138 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 383/762] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:09 2022] GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:09.826719 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-79b16007-85f0-45ac-a9d5-03dcff7b4f9a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:09.827237 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-79b16007-85f0-45ac-a9d5-03dcff7b4f9a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:09.834214 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-79b16007-85f0-45ac-a9d5-03dcff7b4f9a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:09.834734 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-79b16007-85f0-45ac-a9d5-03dcff7b4f9a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:09.835167 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-79b16007-85f0-45ac-a9d5-03dcff7b4f9a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:09.835849 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-79b16007-85f0-45ac-a9d5-03dcff7b4f9a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:09.836293 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-79b16007-85f0-45ac-a9d5-03dcff7b4f9a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:09.836710 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-79b16007-85f0-45ac-a9d5-03dcff7b4f9a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:09.952493 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f52cd108-d422-4431-b67c-0bc5c118aa28 tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] Calling method '.version_select at 0x7f155416cee0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:09.965998 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-79b16007-85f0-45ac-a9d5-03dcff7b4f9a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:09.974915 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-79b16007-85f0-45ac-a9d5-03dcff7b4f9a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:09.976450 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-79b16007-85f0-45ac-a9d5-03dcff7b4f9a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:09.977636 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-79b16007-85f0-45ac-a9d5-03dcff7b4f9a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1745 microversion: 2.20 time: 0.155392 Aug 24 03:58:09.978339 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 380/763] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:09 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:10.000976 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f52cd108-d422-4431-b67c-0bc5c118aa28 tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/cacb89df-a7c8-498e-a630-3f7c47a6ab8e" status: 200 len: 345 microversion: 2.1 time: 0.052675 Aug 24 03:58:10.001547 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 384/764] 10.222.0.82 () {58 vars in 1245 bytes} [Wed Aug 24 03:58:09 2022] GET /compute/v2.1/os-volumes/cacb89df-a7c8-498e-a630-3f7c47a6ab8e => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:58:10.016632 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-171bbaa4-29b1-4d9b-a838-79942842d4c3 tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] Action: 'create', calling method: .version_select at 0x7f1554175c10>, body: {"snapshot": {"volume_id": "cacb89df-a7c8-498e-a630-3f7c47a6ab8e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1188895792"}} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:10.485694 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-171bbaa4-29b1-4d9b-a838-79942842d4c3 tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] 10.222.0.82 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.473864 Aug 24 03:58:10.486560 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 381/765] 10.222.0.82 () {60 vars in 1162 bytes} [Wed Aug 24 03:58:10 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:10.497457 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3404fc93-9086-4076-a06b-306caa88824c tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] Calling method '.version_select at 0x7f155408a310>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:10.530228 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3404fc93-9086-4076-a06b-306caa88824c tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/226567b9-ef75-4e3b-9c80-d7b6dbb848b5" status: 200 len: 287 microversion: 2.1 time: 0.036911 Aug 24 03:58:10.531131 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 385/766] 10.222.0.82 () {58 vars in 1251 bytes} [Wed Aug 24 03:58:10 2022] GET /compute/v2.1/os-snapshots/226567b9-ef75-4e3b-9c80-d7b6dbb848b5 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:10.542071 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-b98ab3e3-e8e8-4287-8669-11c5c2750f0e tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] Calling method '.version_select at 0x7f1554172040>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:10.575265 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-b98ab3e3-e8e8-4287-8669-11c5c2750f0e tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.037236 Aug 24 03:58:10.575827 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 382/767] 10.222.0.82 () {58 vars in 1140 bytes} [Wed Aug 24 03:58:10 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:10.587561 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6be1d669-2fd7-4e48-a5b3-319ac5f96aa3 tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] Calling method '.version_select at 0x7f15541ced30>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:10.613744 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-03fd243b-ddd7-4439-9f5e-dc492c7a6456 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:10.614700 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-03fd243b-ddd7-4439-9f5e-dc492c7a6456 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 66dd80a8-8e33-421c-9c4a-200ad720823a] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:10.620100 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6be1d669-2fd7-4e48-a5b3-319ac5f96aa3 tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/226567b9-ef75-4e3b-9c80-d7b6dbb848b5" status: 200 len: 287 microversion: 2.1 time: 0.037410 Aug 24 03:58:10.620755 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 386/768] 10.222.0.82 () {58 vars in 1251 bytes} [Wed Aug 24 03:58:10 2022] GET /compute/v2.1/os-snapshots/226567b9-ef75-4e3b-9c80-d7b6dbb848b5 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:10.625591 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-03fd243b-ddd7-4439-9f5e-dc492c7a6456 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:10.625591 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-03fd243b-ddd7-4439-9f5e-dc492c7a6456 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:10.625815 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-03fd243b-ddd7-4439-9f5e-dc492c7a6456 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:10.626526 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-03fd243b-ddd7-4439-9f5e-dc492c7a6456 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:10.626982 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-03fd243b-ddd7-4439-9f5e-dc492c7a6456 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:10.627409 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-03fd243b-ddd7-4439-9f5e-dc492c7a6456 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:10.787637 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-03fd243b-ddd7-4439-9f5e-dc492c7a6456 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:10.796345 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-03fd243b-ddd7-4439-9f5e-dc492c7a6456 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a" status: 200 len: 1368 microversion: 2.1 time: 0.186950 Aug 24 03:58:10.797275 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 383/769] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:10 2022] GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a => generated 1368 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:58:10.866155 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-7f79d759-745c-45b8-96e5-1dd9481797ff req-cdda7b44-7171-4350-89b8-ccc5b9df7e09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66dd80a8-8e33-421c-9c4a-200ad720823a", "name": "network-vif-plugged", "status": "completed", "tag": "84ac01da-84a3-455a-9de0-78bfa8ece981"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:10.878022 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-7f79d759-745c-45b8-96e5-1dd9481797ff req-cdda7b44-7171-4350-89b8-ccc5b9df7e09 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:10.878618 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-7f79d759-745c-45b8-96e5-1dd9481797ff req-cdda7b44-7171-4350-89b8-ccc5b9df7e09 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:10.879077 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-7f79d759-745c-45b8-96e5-1dd9481797ff req-cdda7b44-7171-4350-89b8-ccc5b9df7e09 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:10.891036 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-7f79d759-745c-45b8-96e5-1dd9481797ff req-cdda7b44-7171-4350-89b8-ccc5b9df7e09 service nova] Creating event network-vif-plugged:84ac01da-84a3-455a-9de0-78bfa8ece981 for instance 66dd80a8-8e33-421c-9c4a-200ad720823a on hv-cinder-85426 Aug 24 03:58:10.896066 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-7f79d759-745c-45b8-96e5-1dd9481797ff req-cdda7b44-7171-4350-89b8-ccc5b9df7e09 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110771 Aug 24 03:58:10.896814 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 387/770] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:58:11.000780 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-59db9a77-f577-4530-a736-6d5eeec3037c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:11.001299 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-59db9a77-f577-4530-a736-6d5eeec3037c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:11.009315 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-59db9a77-f577-4530-a736-6d5eeec3037c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:11.009828 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-59db9a77-f577-4530-a736-6d5eeec3037c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:11.010349 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-59db9a77-f577-4530-a736-6d5eeec3037c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:11.011076 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-59db9a77-f577-4530-a736-6d5eeec3037c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:11.011525 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-59db9a77-f577-4530-a736-6d5eeec3037c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:11.011949 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-59db9a77-f577-4530-a736-6d5eeec3037c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:11.030485 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell1:SELECT=100 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:11.152022 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-59db9a77-f577-4530-a736-6d5eeec3037c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:11.160186 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-59db9a77-f577-4530-a736-6d5eeec3037c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:11.161929 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-59db9a77-f577-4530-a736-6d5eeec3037c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:11.163130 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-59db9a77-f577-4530-a736-6d5eeec3037c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1740 microversion: 2.20 time: 0.166603 Aug 24 03:58:11.163693 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 384/771] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:10 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1740 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:11.630325 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:11.631154 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:11.635783 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9cb464b2-47be-4c51-b5de-df4d20f6d6d4 tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] Calling method '.version_select at 0x7f1547ffddc0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:11.666725 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9cb464b2-47be-4c51-b5de-df4d20f6d6d4 tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/226567b9-ef75-4e3b-9c80-d7b6dbb848b5" status: 200 len: 287 microversion: 2.1 time: 0.037569 Aug 24 03:58:11.667295 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 388/772] 10.222.0.82 () {58 vars in 1251 bytes} [Wed Aug 24 03:58:11 2022] GET /compute/v2.1/os-snapshots/226567b9-ef75-4e3b-9c80-d7b6dbb848b5 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:11.816747 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-0afa644c-2c64-4fe4-ac19-a4cbe83ca44b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:11.817555 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-0afa644c-2c64-4fe4-ac19-a4cbe83ca44b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 66dd80a8-8e33-421c-9c4a-200ad720823a] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:11.819384 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell0:SELECT=6 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:11.824170 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0afa644c-2c64-4fe4-ac19-a4cbe83ca44b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:11.824645 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0afa644c-2c64-4fe4-ac19-a4cbe83ca44b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:11.825072 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0afa644c-2c64-4fe4-ac19-a4cbe83ca44b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:11.825749 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0afa644c-2c64-4fe4-ac19-a4cbe83ca44b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:11.826187 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0afa644c-2c64-4fe4-ac19-a4cbe83ca44b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:11.826643 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0afa644c-2c64-4fe4-ac19-a4cbe83ca44b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:11.953919 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-0afa644c-2c64-4fe4-ac19-a4cbe83ca44b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:11.962070 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-0afa644c-2c64-4fe4-ac19-a4cbe83ca44b tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a" status: 200 len: 1368 microversion: 2.1 time: 0.149174 Aug 24 03:58:11.962651 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 385/773] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:11 2022] GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:12.186249 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9208aa67-cb0c-4e52-87d9-356d2c4bfc65 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:12.187037 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9208aa67-cb0c-4e52-87d9-356d2c4bfc65 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:12.194251 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9208aa67-cb0c-4e52-87d9-356d2c4bfc65 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:12.194758 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9208aa67-cb0c-4e52-87d9-356d2c4bfc65 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:12.195212 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9208aa67-cb0c-4e52-87d9-356d2c4bfc65 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:12.195941 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9208aa67-cb0c-4e52-87d9-356d2c4bfc65 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:12.196395 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9208aa67-cb0c-4e52-87d9-356d2c4bfc65 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:12.196816 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9208aa67-cb0c-4e52-87d9-356d2c4bfc65 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:12.327317 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-9208aa67-cb0c-4e52-87d9-356d2c4bfc65 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:12.336216 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-9208aa67-cb0c-4e52-87d9-356d2c4bfc65 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:12.337700 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-9208aa67-cb0c-4e52-87d9-356d2c4bfc65 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:12.338877 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9208aa67-cb0c-4e52-87d9-356d2c4bfc65 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1740 microversion: 2.20 time: 0.156827 Aug 24 03:58:12.339425 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 389/774] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:12 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1740 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:12.680049 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-2df3c217-b13f-4986-90bf-54fcaccb6d09 tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] Calling method '.version_select at 0x7f15542b2040>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:12.712348 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-2df3c217-b13f-4986-90bf-54fcaccb6d09 tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/226567b9-ef75-4e3b-9c80-d7b6dbb848b5" status: 200 len: 287 microversion: 2.1 time: 0.036743 Aug 24 03:58:12.712941 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 386/775] 10.222.0.82 () {58 vars in 1251 bytes} [Wed Aug 24 03:58:12 2022] GET /compute/v2.1/os-snapshots/226567b9-ef75-4e3b-9c80-d7b6dbb848b5 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:12.982366 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2b306693-8461-4dae-a868-7c576520bf30 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:12.982992 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2b306693-8461-4dae-a868-7c576520bf30 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 66dd80a8-8e33-421c-9c4a-200ad720823a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:12.990111 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2b306693-8461-4dae-a868-7c576520bf30 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:12.990635 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2b306693-8461-4dae-a868-7c576520bf30 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:12.991070 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2b306693-8461-4dae-a868-7c576520bf30 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:12.991761 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2b306693-8461-4dae-a868-7c576520bf30 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:12.992215 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2b306693-8461-4dae-a868-7c576520bf30 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:12.992730 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2b306693-8461-4dae-a868-7c576520bf30 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:13.132489 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-2b306693-8461-4dae-a868-7c576520bf30 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:13.140438 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2b306693-8461-4dae-a868-7c576520bf30 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a" status: 200 len: 1368 microversion: 2.1 time: 0.162023 Aug 24 03:58:13.141017 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 390/776] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:12 2022] GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:13.361471 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-b8f8f011-89a5-4d3e-ba5e-9f62212048d7 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:13.361988 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-b8f8f011-89a5-4d3e-ba5e-9f62212048d7 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:13.368491 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b8f8f011-89a5-4d3e-ba5e-9f62212048d7 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:13.368967 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b8f8f011-89a5-4d3e-ba5e-9f62212048d7 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:13.369398 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b8f8f011-89a5-4d3e-ba5e-9f62212048d7 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:13.370078 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b8f8f011-89a5-4d3e-ba5e-9f62212048d7 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:13.370544 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b8f8f011-89a5-4d3e-ba5e-9f62212048d7 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:13.370969 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b8f8f011-89a5-4d3e-ba5e-9f62212048d7 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:13.529827 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-b8f8f011-89a5-4d3e-ba5e-9f62212048d7 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:13.539066 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-b8f8f011-89a5-4d3e-ba5e-9f62212048d7 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:13.540818 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-b8f8f011-89a5-4d3e-ba5e-9f62212048d7 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:13.542448 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-b8f8f011-89a5-4d3e-ba5e-9f62212048d7 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1740 microversion: 2.20 time: 0.184844 Aug 24 03:58:13.543049 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 387/777] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:13 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:13.725215 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b6399677-1663-4469-a540-d1b0efe76121 tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] Calling method '.version_select at 0x7f1547fc3ee0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:13.757247 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b6399677-1663-4469-a540-d1b0efe76121 tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/226567b9-ef75-4e3b-9c80-d7b6dbb848b5" status: 200 len: 288 microversion: 2.1 time: 0.036109 Aug 24 03:58:13.757969 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 391/778] 10.222.0.82 () {58 vars in 1251 bytes} [Wed Aug 24 03:58:13 2022] GET /compute/v2.1/os-snapshots/226567b9-ef75-4e3b-9c80-d7b6dbb848b5 => generated 288 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:13.769085 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-7aed96fa-32e1-414a-938f-810ae1d6380d tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] Calling method '.version_select at 0x7f15543205e0>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:13.886863 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-7aed96fa-32e1-414a-938f-810ae1d6380d tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] 10.222.0.82 "DELETE /compute/v2.1/os-snapshots/226567b9-ef75-4e3b-9c80-d7b6dbb848b5" status: 202 len: 0 microversion: 2.1 time: 0.121622 Aug 24 03:58:13.887422 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 388/779] 10.222.0.82 () {58 vars in 1254 bytes} [Wed Aug 24 03:58:13 2022] DELETE /compute/v2.1/os-snapshots/226567b9-ef75-4e3b-9c80-d7b6dbb848b5 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:58:13.896271 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-84525379-bdbe-46ac-84cb-f3addd9d40e0 tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] Calling method '.version_select at 0x7f155408a280>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:13.932549 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-84525379-bdbe-46ac-84cb-f3addd9d40e0 tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/226567b9-ef75-4e3b-9c80-d7b6dbb848b5" status: 200 len: 287 microversion: 2.1 time: 0.040829 Aug 24 03:58:13.933150 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 392/780] 10.222.0.82 () {58 vars in 1251 bytes} [Wed Aug 24 03:58:13 2022] GET /compute/v2.1/os-snapshots/226567b9-ef75-4e3b-9c80-d7b6dbb848b5 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:14.163152 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-d3414b7d-de3a-470d-b475-6714852b069f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:14.164199 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-d3414b7d-de3a-470d-b475-6714852b069f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 66dd80a8-8e33-421c-9c4a-200ad720823a] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:14.171532 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d3414b7d-de3a-470d-b475-6714852b069f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:14.185682 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d3414b7d-de3a-470d-b475-6714852b069f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:14.185682 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d3414b7d-de3a-470d-b475-6714852b069f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:14.185682 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d3414b7d-de3a-470d-b475-6714852b069f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:14.185682 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d3414b7d-de3a-470d-b475-6714852b069f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:14.186159 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d3414b7d-de3a-470d-b475-6714852b069f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:14.314700 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-d3414b7d-de3a-470d-b475-6714852b069f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:14.327100 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-d3414b7d-de3a-470d-b475-6714852b069f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a" status: 200 len: 1368 microversion: 2.1 time: 0.165350 Aug 24 03:58:14.327878 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 389/781] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:14 2022] GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:14.566412 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4730a297-756d-4536-b7d0-d41f23a89133 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:14.567074 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4730a297-756d-4536-b7d0-d41f23a89133 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:14.574012 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4730a297-756d-4536-b7d0-d41f23a89133 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:14.574769 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4730a297-756d-4536-b7d0-d41f23a89133 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:14.575207 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4730a297-756d-4536-b7d0-d41f23a89133 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:14.575910 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4730a297-756d-4536-b7d0-d41f23a89133 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:14.576364 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4730a297-756d-4536-b7d0-d41f23a89133 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:14.576793 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4730a297-756d-4536-b7d0-d41f23a89133 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:14.734863 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-4730a297-756d-4536-b7d0-d41f23a89133 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:14.748455 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-4730a297-756d-4536-b7d0-d41f23a89133 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:14.750131 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-4730a297-756d-4536-b7d0-d41f23a89133 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:14.751452 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4730a297-756d-4536-b7d0-d41f23a89133 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1740 microversion: 2.20 time: 0.189789 Aug 24 03:58:14.755421 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 393/782] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:14 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1740 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:14.945617 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-a4109eb9-b9ff-4c39-9d51-5fd3cd3adbe6 tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] Calling method '.version_select at 0x7f15542b2e50>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:14.974436 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.wsgi [None req-a4109eb9-b9ff-4c39-9d51-5fd3cd3adbe6 tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] HTTP exception thrown: Snapshot 226567b9-ef75-4e3b-9c80-d7b6dbb848b5 could not be found. Aug 24 03:58:14.976729 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-a4109eb9-b9ff-4c39-9d51-5fd3cd3adbe6 tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] Request method failure captured: Aug 24 03:58:14.976729 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: request: GET /compute/v2.1/os-snapshots/226567b9-ef75-4e3b-9c80-d7b6dbb848b5 HTTP/1.1 Aug 24 03:58:14.976729 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept: application/json Aug 24 03:58:14.976729 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept-Encoding: identity Aug 24 03:58:14.976729 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Connection: close Aug 24 03:58:14.976729 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Length: 0 Aug 24 03:58:14.976729 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Type: application/json Aug 24 03:58:14.976729 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Host: 10.222.0.82 Aug 24 03:58:14.976729 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Openstack-System-Scope: None Aug 24 03:58:14.976729 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: User-Agent: python-urllib3/1.26.11 Aug 24 03:58:14.976729 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Auth-Token: gAAAAABjBaHQECza2ef4MsKa3CF5Poytx8dr8DxFHedoERlNc02ZtXMYFC2Gspx36N9APwaIW7ngfQFxy9IevQ3wjXK-am5Hhe1-Nj6Mki7olCqukJdD-RMCjaV8HzuFkzIPWZ8O4n_cI4iEnCUZa4MMlznkSnAdEuo9jUc0RdScK8TjHHSa9m0 Aug 24 03:58:14.976729 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Id: None Aug 24 03:58:14.976729 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Name: None Aug 24 03:58:14.976729 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Identity-Status: Confirmed Aug 24 03:58:14.976729 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Is-Admin-Project: True Aug 24 03:58:14.976729 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Id: default Aug 24 03:58:14.976729 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Name: Default Aug 24 03:58:14.976729 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Id: 4b1b41a3dc9442ad9f47d480d57fc972 Aug 24 03:58:14.976729 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1762961223 Aug 24 03:58:14.976729 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Role: member,reader Aug 24 03:58:14.976729 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Roles: member,reader Aug 24 03:58:14.978378 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/4b1b41a3dc9442ad9f47d480d57fc972"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/4b1b41a3dc9442ad9f47d480d57fc972"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/4b1b41a3dc9442ad9f47d480d57fc972"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_4b1b41a3dc9442ad9f47d480d57fc972", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:58:14.978378 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1762961223 Aug 24 03:58:14.978378 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Id: 4b1b41a3dc9442ad9f47d480d57fc972 Aug 24 03:58:14.978378 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1762961223 Aug 24 03:58:14.978378 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User: tempest-VolumesSnapshotsTestJSON-1762961223-project Aug 24 03:58:14.978378 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Id: default Aug 24 03:58:14.978378 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Name: Default Aug 24 03:58:14.978378 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Id: f93377bef018419dac5865e02816039a Aug 24 03:58:14.978378 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1762961223-project Aug 24 03:58:14.978378 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: method: Aug 24 03:58:14.978378 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: exception: Snapshot 226567b9-ef75-4e3b-9c80-d7b6dbb848b5 could not be found. Aug 24 03:58:14.978378 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: action_args: {'id': '226567b9-ef75-4e3b-9c80-d7b6dbb848b5'} Aug 24 03:58:14.978378 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:58:14.979440 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:58:14.979440 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 03:58:14.979440 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 03:58:14.979440 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 03:58:14.979440 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 03:58:14.979440 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 03:58:14.979440 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 03:58:14.979440 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:58:14.979440 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:58:14.979440 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:58:14.979440 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:58:14.979440 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:58:14.979440 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:58:14.979440 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:58:14.979440 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:58:14.979440 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 226567b9-ef75-4e3b-9c80-d7b6dbb848b5 could not be found. (HTTP 404) (Request-ID: req-dd138f44-eb3e-45b5-acae-3ca565490188) Aug 24 03:58:14.979440 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:58:14.979440 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:58:14.980999 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:58:14.980999 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:58:14.980999 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 24 03:58:14.980999 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 24 03:58:14.980999 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:58:14.980999 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:58:14.980999 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 24 03:58:14.980999 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 24 03:58:14.980999 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:58:14.980999 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:58:14.980999 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 03:58:14.980999 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 03:58:14.980999 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 03:58:14.980999 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 03:58:14.980999 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 03:58:14.980999 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 03:58:14.980999 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:58:14.980999 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:58:14.980999 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:58:14.982186 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:58:14.982186 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:58:14.982186 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:58:14.982186 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:58:14.982186 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:58:14.982186 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 226567b9-ef75-4e3b-9c80-d7b6dbb848b5 could not be found. Aug 24 03:58:14.982186 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:58:14.982186 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:58:14.982186 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:58:14.982186 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:58:14.982186 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:58:14.982186 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:58:14.982186 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:58:14.982186 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:58:14.982186 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:58:14.982186 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:58:14.982186 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:58:14.982186 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:58:14.982186 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 24 03:58:14.982186 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:58:14.983495 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 226567b9-ef75-4e3b-9c80-d7b6dbb848b5 could not be found. Aug 24 03:58:14.983495 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:58:14.983495 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:58:14.983495 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:58:14.983495 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:58:14.983495 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:58:14.983495 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:58:14.983495 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:58:14.983495 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:58:14.983495 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 226567b9-ef75-4e3b-9c80-d7b6dbb848b5 could not be found. Aug 24 03:58:14.983495 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:58:14.983495 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-a4109eb9-b9ff-4c39-9d51-5fd3cd3adbe6 tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] Returning 404 to user: Snapshot 226567b9-ef75-4e3b-9c80-d7b6dbb848b5 could not be found. {{(pid=127869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:58:14.983495 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-a4109eb9-b9ff-4c39-9d51-5fd3cd3adbe6 tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/226567b9-ef75-4e3b-9c80-d7b6dbb848b5" status: 404 len: 111 microversion: 2.1 time: 0.036982 Aug 24 03:58:14.984324 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 390/783] 10.222.0.82 () {58 vars in 1251 bytes} [Wed Aug 24 03:58:14 2022] GET /compute/v2.1/os-snapshots/226567b9-ef75-4e3b-9c80-d7b6dbb848b5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:58:14.993951 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-be682e9e-c735-48a8-8a42-dae04b9515d1 tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] Calling method '.version_select at 0x7f1547fc3430>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:15.221690 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-be682e9e-c735-48a8-8a42-dae04b9515d1 tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] 10.222.0.82 "DELETE /compute/v2.1/os-volumes/cacb89df-a7c8-498e-a630-3f7c47a6ab8e" status: 202 len: 0 microversion: 2.1 time: 0.231485 Aug 24 03:58:15.222631 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 394/784] 10.222.0.82 () {58 vars in 1248 bytes} [Wed Aug 24 03:58:14 2022] DELETE /compute/v2.1/os-volumes/cacb89df-a7c8-498e-a630-3f7c47a6ab8e => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:58:15.230523 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-74857957-a453-4bf9-8003-4457746cc4aa tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] Calling method '.version_select at 0x7f15541d0160>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:15.283465 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-74857957-a453-4bf9-8003-4457746cc4aa tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/cacb89df-a7c8-498e-a630-3f7c47a6ab8e" status: 200 len: 344 microversion: 2.1 time: 0.056732 Aug 24 03:58:15.284600 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 391/785] 10.222.0.82 () {58 vars in 1245 bytes} [Wed Aug 24 03:58:15 2022] GET /compute/v2.1/os-volumes/cacb89df-a7c8-498e-a630-3f7c47a6ab8e => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:58:15.348781 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ffaa6701-141b-402d-913a-a7ff5272e678 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:15.349665 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ffaa6701-141b-402d-913a-a7ff5272e678 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 66dd80a8-8e33-421c-9c4a-200ad720823a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:15.356385 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ffaa6701-141b-402d-913a-a7ff5272e678 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:15.357230 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ffaa6701-141b-402d-913a-a7ff5272e678 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:15.357820 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ffaa6701-141b-402d-913a-a7ff5272e678 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:15.358733 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ffaa6701-141b-402d-913a-a7ff5272e678 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:15.359337 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ffaa6701-141b-402d-913a-a7ff5272e678 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:15.359910 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ffaa6701-141b-402d-913a-a7ff5272e678 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:15.365166 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:15.522710 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-ffaa6701-141b-402d-913a-a7ff5272e678 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:15.533567 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ffaa6701-141b-402d-913a-a7ff5272e678 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a" status: 200 len: 1368 microversion: 2.1 time: 0.188684 Aug 24 03:58:15.534194 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 395/786] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:15 2022] GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a => generated 1368 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:15.670664 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-046d6ead-d23a-4ef3-b94b-c4310c03d5ec req-7b321d10-c5c6-44b8-9006-6fa262c2d625 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df85e6fe-54b4-456b-875d-7c3b6418c40e", "name": "network-vif-plugged", "status": "completed", "tag": "b70bff9a-be9c-4b03-8c48-2151d8730e62"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:15.689061 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-046d6ead-d23a-4ef3-b94b-c4310c03d5ec req-7b321d10-c5c6-44b8-9006-6fa262c2d625 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:15.689992 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-046d6ead-d23a-4ef3-b94b-c4310c03d5ec req-7b321d10-c5c6-44b8-9006-6fa262c2d625 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:15.691205 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-046d6ead-d23a-4ef3-b94b-c4310c03d5ec req-7b321d10-c5c6-44b8-9006-6fa262c2d625 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:15.712101 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-046d6ead-d23a-4ef3-b94b-c4310c03d5ec req-7b321d10-c5c6-44b8-9006-6fa262c2d625 service nova] Creating event network-vif-plugged:b70bff9a-be9c-4b03-8c48-2151d8730e62 for instance df85e6fe-54b4-456b-875d-7c3b6418c40e on hv-cinder-85426 Aug 24 03:58:15.717307 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-046d6ead-d23a-4ef3-b94b-c4310c03d5ec req-7b321d10-c5c6-44b8-9006-6fa262c2d625 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051206 Aug 24 03:58:15.718326 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 392/787] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:15.776250 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a822c62c-998e-4b51-aab4-a4bbdd821eb9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:15.776855 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a822c62c-998e-4b51-aab4-a4bbdd821eb9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:15.785610 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a822c62c-998e-4b51-aab4-a4bbdd821eb9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:15.786278 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a822c62c-998e-4b51-aab4-a4bbdd821eb9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:15.787001 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a822c62c-998e-4b51-aab4-a4bbdd821eb9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:15.788022 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a822c62c-998e-4b51-aab4-a4bbdd821eb9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:15.788553 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a822c62c-998e-4b51-aab4-a4bbdd821eb9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:15.789094 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a822c62c-998e-4b51-aab4-a4bbdd821eb9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:15.948087 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-a822c62c-998e-4b51-aab4-a4bbdd821eb9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:15.959607 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-a822c62c-998e-4b51-aab4-a4bbdd821eb9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:15.961457 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-a822c62c-998e-4b51-aab4-a4bbdd821eb9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:15.963017 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a822c62c-998e-4b51-aab4-a4bbdd821eb9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1740 microversion: 2.20 time: 0.190822 Aug 24 03:58:15.976283 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 396/788] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:15 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1740 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:16.299830 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-8ef6aada-5090-4234-8af6-fdfd968e5389 tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] Calling method '.version_select at 0x7f155452bd30>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:16.333764 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.wsgi [None req-8ef6aada-5090-4234-8af6-fdfd968e5389 tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] HTTP exception thrown: Volume cacb89df-a7c8-498e-a630-3f7c47a6ab8e could not be found. Aug 24 03:58:16.335911 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-8ef6aada-5090-4234-8af6-fdfd968e5389 tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] Request method failure captured: Aug 24 03:58:16.335911 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: request: GET /compute/v2.1/os-volumes/cacb89df-a7c8-498e-a630-3f7c47a6ab8e HTTP/1.1 Aug 24 03:58:16.335911 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept: application/json Aug 24 03:58:16.335911 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept-Encoding: identity Aug 24 03:58:16.335911 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Connection: close Aug 24 03:58:16.335911 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Length: 0 Aug 24 03:58:16.335911 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Type: application/json Aug 24 03:58:16.335911 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Host: 10.222.0.82 Aug 24 03:58:16.335911 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Openstack-System-Scope: None Aug 24 03:58:16.335911 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: User-Agent: python-urllib3/1.26.11 Aug 24 03:58:16.335911 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Auth-Token: gAAAAABjBaHQECza2ef4MsKa3CF5Poytx8dr8DxFHedoERlNc02ZtXMYFC2Gspx36N9APwaIW7ngfQFxy9IevQ3wjXK-am5Hhe1-Nj6Mki7olCqukJdD-RMCjaV8HzuFkzIPWZ8O4n_cI4iEnCUZa4MMlznkSnAdEuo9jUc0RdScK8TjHHSa9m0 Aug 24 03:58:16.335911 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Id: None Aug 24 03:58:16.335911 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Name: None Aug 24 03:58:16.335911 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Identity-Status: Confirmed Aug 24 03:58:16.335911 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Is-Admin-Project: True Aug 24 03:58:16.335911 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Id: default Aug 24 03:58:16.335911 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Name: Default Aug 24 03:58:16.335911 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Id: 4b1b41a3dc9442ad9f47d480d57fc972 Aug 24 03:58:16.335911 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1762961223 Aug 24 03:58:16.335911 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Role: member,reader Aug 24 03:58:16.335911 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Roles: member,reader Aug 24 03:58:16.337272 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/4b1b41a3dc9442ad9f47d480d57fc972"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/4b1b41a3dc9442ad9f47d480d57fc972"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/4b1b41a3dc9442ad9f47d480d57fc972"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_4b1b41a3dc9442ad9f47d480d57fc972", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:58:16.337272 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1762961223 Aug 24 03:58:16.337272 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Id: 4b1b41a3dc9442ad9f47d480d57fc972 Aug 24 03:58:16.337272 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1762961223 Aug 24 03:58:16.337272 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User: tempest-VolumesSnapshotsTestJSON-1762961223-project Aug 24 03:58:16.337272 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Id: default Aug 24 03:58:16.337272 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Name: Default Aug 24 03:58:16.337272 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Id: f93377bef018419dac5865e02816039a Aug 24 03:58:16.337272 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1762961223-project Aug 24 03:58:16.337272 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: method: Aug 24 03:58:16.337272 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: exception: Volume cacb89df-a7c8-498e-a630-3f7c47a6ab8e could not be found. Aug 24 03:58:16.337272 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: action_args: {'id': 'cacb89df-a7c8-498e-a630-3f7c47a6ab8e'} Aug 24 03:58:16.337272 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:58:16.338179 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:58:16.338179 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:58:16.338179 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:58:16.338179 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:58:16.338179 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:58:16.338179 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:58:16.338179 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:58:16.338179 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:58:16.338179 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:58:16.338179 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:58:16.338179 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:58:16.338179 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:58:16.338179 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:58:16.338179 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:58:16.338179 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:58:16.338179 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cacb89df-a7c8-498e-a630-3f7c47a6ab8e could not be found. (HTTP 404) (Request-ID: req-703c3806-028e-4fcd-a243-b4c54373f75e) Aug 24 03:58:16.338179 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:58:16.338179 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:58:16.338179 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:58:16.339417 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:58:16.339417 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 03:58:16.339417 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 03:58:16.339417 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:58:16.339417 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:58:16.339417 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 03:58:16.339417 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 03:58:16.339417 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:58:16.339417 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:58:16.339417 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:58:16.339417 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:58:16.339417 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:58:16.339417 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:58:16.339417 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:58:16.339417 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:58:16.339417 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:58:16.339417 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:58:16.339417 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:58:16.339417 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:58:16.342712 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:58:16.342712 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:58:16.342712 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:58:16.342712 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:58:16.342712 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cacb89df-a7c8-498e-a630-3f7c47a6ab8e could not be found. Aug 24 03:58:16.342712 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:58:16.342712 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:58:16.342712 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:58:16.342712 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:58:16.342712 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:58:16.342712 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:58:16.342712 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:58:16.342712 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:58:16.342712 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:58:16.342712 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:58:16.342712 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:58:16.342712 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:58:16.342712 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 03:58:16.342712 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:58:16.345112 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cacb89df-a7c8-498e-a630-3f7c47a6ab8e could not be found. Aug 24 03:58:16.345112 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:58:16.345112 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:58:16.345112 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:58:16.345112 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:58:16.345112 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:58:16.345112 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:58:16.345112 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:58:16.345112 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:58:16.345112 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cacb89df-a7c8-498e-a630-3f7c47a6ab8e could not be found. Aug 24 03:58:16.345112 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:58:16.345112 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-8ef6aada-5090-4234-8af6-fdfd968e5389 tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] Returning 404 to user: Volume cacb89df-a7c8-498e-a630-3f7c47a6ab8e could not be found. {{(pid=127869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:58:16.345112 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-8ef6aada-5090-4234-8af6-fdfd968e5389 tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/cacb89df-a7c8-498e-a630-3f7c47a6ab8e" status: 404 len: 109 microversion: 2.1 time: 0.042849 Aug 24 03:58:16.345112 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 393/789] 10.222.0.82 () {58 vars in 1245 bytes} [Wed Aug 24 03:58:16 2022] GET /compute/v2.1/os-volumes/cacb89df-a7c8-498e-a630-3f7c47a6ab8e => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:58:16.348609 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f8c615d4-cf80-4bd4-bd97-1c47e5a82e43 tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] Calling method '.version_select at 0x7f15541cec10>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:16.383921 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-f8c615d4-cf80-4bd4-bd97-1c47e5a82e43 tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] HTTP exception thrown: Volume cacb89df-a7c8-498e-a630-3f7c47a6ab8e could not be found. Aug 24 03:58:16.386983 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f8c615d4-cf80-4bd4-bd97-1c47e5a82e43 tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] Request method failure captured: Aug 24 03:58:16.386983 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: request: DELETE /compute/v2.1/os-volumes/cacb89df-a7c8-498e-a630-3f7c47a6ab8e HTTP/1.1 Aug 24 03:58:16.386983 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept: application/json Aug 24 03:58:16.386983 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept-Encoding: identity Aug 24 03:58:16.386983 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Connection: close Aug 24 03:58:16.386983 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Length: 0 Aug 24 03:58:16.386983 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Type: application/json Aug 24 03:58:16.386983 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Host: 10.222.0.82 Aug 24 03:58:16.386983 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Openstack-System-Scope: None Aug 24 03:58:16.386983 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.11 Aug 24 03:58:16.386983 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Auth-Token: gAAAAABjBaHQECza2ef4MsKa3CF5Poytx8dr8DxFHedoERlNc02ZtXMYFC2Gspx36N9APwaIW7ngfQFxy9IevQ3wjXK-am5Hhe1-Nj6Mki7olCqukJdD-RMCjaV8HzuFkzIPWZ8O4n_cI4iEnCUZa4MMlznkSnAdEuo9jUc0RdScK8TjHHSa9m0 Aug 24 03:58:16.386983 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Id: None Aug 24 03:58:16.386983 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Name: None Aug 24 03:58:16.386983 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Identity-Status: Confirmed Aug 24 03:58:16.386983 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Is-Admin-Project: True Aug 24 03:58:16.386983 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Id: default Aug 24 03:58:16.386983 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Name: Default Aug 24 03:58:16.386983 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Id: 4b1b41a3dc9442ad9f47d480d57fc972 Aug 24 03:58:16.386983 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1762961223 Aug 24 03:58:16.386983 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Role: member,reader Aug 24 03:58:16.386983 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Roles: member,reader Aug 24 03:58:16.388553 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/4b1b41a3dc9442ad9f47d480d57fc972"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/4b1b41a3dc9442ad9f47d480d57fc972"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/4b1b41a3dc9442ad9f47d480d57fc972"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_4b1b41a3dc9442ad9f47d480d57fc972", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:58:16.388553 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1762961223 Aug 24 03:58:16.388553 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Id: 4b1b41a3dc9442ad9f47d480d57fc972 Aug 24 03:58:16.388553 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1762961223 Aug 24 03:58:16.388553 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User: tempest-VolumesSnapshotsTestJSON-1762961223-project Aug 24 03:58:16.388553 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Id: default Aug 24 03:58:16.388553 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Name: Default Aug 24 03:58:16.388553 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Id: f93377bef018419dac5865e02816039a Aug 24 03:58:16.388553 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1762961223-project Aug 24 03:58:16.388553 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: method: Aug 24 03:58:16.388553 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: exception: Volume cacb89df-a7c8-498e-a630-3f7c47a6ab8e could not be found. Aug 24 03:58:16.388553 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: action_args: {'id': 'cacb89df-a7c8-498e-a630-3f7c47a6ab8e'} Aug 24 03:58:16.388553 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:58:16.389540 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:58:16.389540 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:58:16.389540 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:58:16.389540 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 03:58:16.389540 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 03:58:16.389540 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 03:58:16.389540 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 03:58:16.389540 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 03:58:16.389540 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 03:58:16.389540 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 03:58:16.389540 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 03:58:16.389540 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:58:16.389540 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:58:16.389540 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:58:16.389540 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:58:16.389540 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cacb89df-a7c8-498e-a630-3f7c47a6ab8e could not be found. (HTTP 404) (Request-ID: req-fb9b8ebb-8065-4387-863d-012f92ce8ca6) Aug 24 03:58:16.389540 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:58:16.389540 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:58:16.389540 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:58:16.390970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:58:16.390970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 03:58:16.390970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 03:58:16.390970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:58:16.390970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:58:16.390970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 03:58:16.390970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 03:58:16.390970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:58:16.390970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:58:16.390970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:58:16.390970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:58:16.390970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 03:58:16.390970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 03:58:16.390970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 03:58:16.390970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 03:58:16.390970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 03:58:16.390970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 03:58:16.390970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 03:58:16.390970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 03:58:16.395970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:58:16.395970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:58:16.395970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:58:16.395970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:58:16.395970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cacb89df-a7c8-498e-a630-3f7c47a6ab8e could not be found. Aug 24 03:58:16.395970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:58:16.395970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:58:16.395970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:58:16.395970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:58:16.395970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:58:16.395970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:58:16.395970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:58:16.395970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:58:16.395970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:58:16.395970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:58:16.395970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:58:16.395970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:58:16.395970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 03:58:16.395970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:58:16.397868 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cacb89df-a7c8-498e-a630-3f7c47a6ab8e could not be found. Aug 24 03:58:16.397868 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:58:16.397868 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:58:16.397868 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:58:16.397868 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:58:16.397868 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:58:16.397868 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:58:16.397868 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:58:16.397868 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:58:16.397868 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cacb89df-a7c8-498e-a630-3f7c47a6ab8e could not be found. Aug 24 03:58:16.397868 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:58:16.397868 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f8c615d4-cf80-4bd4-bd97-1c47e5a82e43 tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] Returning 404 to user: Volume cacb89df-a7c8-498e-a630-3f7c47a6ab8e could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:58:16.397868 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f8c615d4-cf80-4bd4-bd97-1c47e5a82e43 tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] 10.222.0.82 "DELETE /compute/v2.1/os-volumes/cacb89df-a7c8-498e-a630-3f7c47a6ab8e" status: 404 len: 109 microversion: 2.1 time: 0.043569 Aug 24 03:58:16.397868 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 397/790] 10.222.0.82 () {58 vars in 1248 bytes} [Wed Aug 24 03:58:16 2022] DELETE /compute/v2.1/os-volumes/cacb89df-a7c8-498e-a630-3f7c47a6ab8e => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:58:16.400839 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-02a67ae3-c6d5-421e-88e9-4bd0ccddea26 tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] Calling method '.version_select at 0x7f15541d03a0>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:16.435691 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.wsgi [None req-02a67ae3-c6d5-421e-88e9-4bd0ccddea26 tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] HTTP exception thrown: Volume cacb89df-a7c8-498e-a630-3f7c47a6ab8e could not be found. Aug 24 03:58:16.439331 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-02a67ae3-c6d5-421e-88e9-4bd0ccddea26 tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] Request method failure captured: Aug 24 03:58:16.439331 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: request: GET /compute/v2.1/os-volumes/cacb89df-a7c8-498e-a630-3f7c47a6ab8e HTTP/1.1 Aug 24 03:58:16.439331 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept: application/json Aug 24 03:58:16.439331 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept-Encoding: identity Aug 24 03:58:16.439331 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Connection: close Aug 24 03:58:16.439331 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Length: 0 Aug 24 03:58:16.439331 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Type: application/json Aug 24 03:58:16.439331 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Host: 10.222.0.82 Aug 24 03:58:16.439331 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Openstack-System-Scope: None Aug 24 03:58:16.439331 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: User-Agent: python-urllib3/1.26.11 Aug 24 03:58:16.439331 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Auth-Token: gAAAAABjBaHQECza2ef4MsKa3CF5Poytx8dr8DxFHedoERlNc02ZtXMYFC2Gspx36N9APwaIW7ngfQFxy9IevQ3wjXK-am5Hhe1-Nj6Mki7olCqukJdD-RMCjaV8HzuFkzIPWZ8O4n_cI4iEnCUZa4MMlznkSnAdEuo9jUc0RdScK8TjHHSa9m0 Aug 24 03:58:16.439331 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Id: None Aug 24 03:58:16.439331 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Name: None Aug 24 03:58:16.439331 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Identity-Status: Confirmed Aug 24 03:58:16.439331 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Is-Admin-Project: True Aug 24 03:58:16.439331 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Id: default Aug 24 03:58:16.439331 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Name: Default Aug 24 03:58:16.439331 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Id: 4b1b41a3dc9442ad9f47d480d57fc972 Aug 24 03:58:16.439331 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1762961223 Aug 24 03:58:16.439331 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Role: member,reader Aug 24 03:58:16.439331 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Roles: member,reader Aug 24 03:58:16.445848 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/4b1b41a3dc9442ad9f47d480d57fc972"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/4b1b41a3dc9442ad9f47d480d57fc972"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/4b1b41a3dc9442ad9f47d480d57fc972"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_4b1b41a3dc9442ad9f47d480d57fc972", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:58:16.445848 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1762961223 Aug 24 03:58:16.445848 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Id: 4b1b41a3dc9442ad9f47d480d57fc972 Aug 24 03:58:16.445848 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1762961223 Aug 24 03:58:16.445848 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User: tempest-VolumesSnapshotsTestJSON-1762961223-project Aug 24 03:58:16.445848 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Id: default Aug 24 03:58:16.445848 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Name: Default Aug 24 03:58:16.445848 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Id: f93377bef018419dac5865e02816039a Aug 24 03:58:16.445848 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1762961223-project Aug 24 03:58:16.445848 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: method: Aug 24 03:58:16.445848 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: exception: Volume cacb89df-a7c8-498e-a630-3f7c47a6ab8e could not be found. Aug 24 03:58:16.445848 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: action_args: {'id': 'cacb89df-a7c8-498e-a630-3f7c47a6ab8e'} Aug 24 03:58:16.445848 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:58:16.446874 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:58:16.446874 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:58:16.446874 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:58:16.446874 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:58:16.446874 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:58:16.446874 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:58:16.446874 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:58:16.446874 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:58:16.446874 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:58:16.446874 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:58:16.446874 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:58:16.446874 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:58:16.446874 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:58:16.446874 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:58:16.446874 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:58:16.446874 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cacb89df-a7c8-498e-a630-3f7c47a6ab8e could not be found. (HTTP 404) (Request-ID: req-7922d32e-b121-480c-9ce8-95b089b1ccb6) Aug 24 03:58:16.446874 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:58:16.446874 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:58:16.446874 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:58:16.448582 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:58:16.448582 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 03:58:16.448582 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 03:58:16.448582 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:58:16.448582 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:58:16.448582 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 03:58:16.448582 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 03:58:16.448582 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:58:16.448582 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:58:16.448582 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:58:16.448582 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:58:16.448582 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:58:16.448582 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:58:16.448582 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:58:16.448582 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:58:16.448582 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:58:16.448582 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:58:16.448582 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:58:16.448582 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:58:16.450067 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:58:16.450067 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:58:16.450067 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:58:16.450067 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:58:16.450067 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cacb89df-a7c8-498e-a630-3f7c47a6ab8e could not be found. Aug 24 03:58:16.450067 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:58:16.450067 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:58:16.450067 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:58:16.450067 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:58:16.450067 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:58:16.450067 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:58:16.450067 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:58:16.450067 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:58:16.450067 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:58:16.450067 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:58:16.450067 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:58:16.450067 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:58:16.450067 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 03:58:16.450067 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:58:16.452508 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cacb89df-a7c8-498e-a630-3f7c47a6ab8e could not be found. Aug 24 03:58:16.452508 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:58:16.452508 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:58:16.452508 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:58:16.452508 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:58:16.452508 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:58:16.452508 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:58:16.452508 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:58:16.452508 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:58:16.452508 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cacb89df-a7c8-498e-a630-3f7c47a6ab8e could not be found. Aug 24 03:58:16.452508 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:58:16.452508 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-02a67ae3-c6d5-421e-88e9-4bd0ccddea26 tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] Returning 404 to user: Volume cacb89df-a7c8-498e-a630-3f7c47a6ab8e could not be found. {{(pid=127869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:58:16.452508 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-02a67ae3-c6d5-421e-88e9-4bd0ccddea26 tempest-VolumesSnapshotsTestJSON-1762961223 tempest-VolumesSnapshotsTestJSON-1762961223-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/cacb89df-a7c8-498e-a630-3f7c47a6ab8e" status: 404 len: 109 microversion: 2.1 time: 0.044567 Aug 24 03:58:16.452508 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 394/791] 10.222.0.82 () {58 vars in 1245 bytes} [Wed Aug 24 03:58:16 2022] GET /compute/v2.1/os-volumes/cacb89df-a7c8-498e-a630-3f7c47a6ab8e => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:58:16.560979 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-315e4c63-dd89-4c4d-923b-2406b3159abc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:16.562079 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-315e4c63-dd89-4c4d-923b-2406b3159abc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 66dd80a8-8e33-421c-9c4a-200ad720823a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:16.576900 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-315e4c63-dd89-4c4d-923b-2406b3159abc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:16.582154 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-315e4c63-dd89-4c4d-923b-2406b3159abc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:16.582154 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-315e4c63-dd89-4c4d-923b-2406b3159abc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:16.582154 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-315e4c63-dd89-4c4d-923b-2406b3159abc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:16.582154 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-315e4c63-dd89-4c4d-923b-2406b3159abc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:16.582991 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-315e4c63-dd89-4c4d-923b-2406b3159abc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:16.746430 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-315e4c63-dd89-4c4d-923b-2406b3159abc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:16.756231 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-315e4c63-dd89-4c4d-923b-2406b3159abc tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a" status: 200 len: 1559 microversion: 2.1 time: 0.202352 Aug 24 03:58:16.756801 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 398/792] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:16 2022] GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a => generated 1559 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:16.776535 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-30edb8e1-b50d-4363-95b5-237c40d534c2 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:16.777151 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-30edb8e1-b50d-4363-95b5-237c40d534c2 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 66dd80a8-8e33-421c-9c4a-200ad720823a] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:16.783743 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-30edb8e1-b50d-4363-95b5-237c40d534c2 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:16.784325 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-30edb8e1-b50d-4363-95b5-237c40d534c2 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:16.784821 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-30edb8e1-b50d-4363-95b5-237c40d534c2 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:16.786093 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-30edb8e1-b50d-4363-95b5-237c40d534c2 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:16.786688 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-30edb8e1-b50d-4363-95b5-237c40d534c2 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:16.787327 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-30edb8e1-b50d-4363-95b5-237c40d534c2 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:16.873162 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-30edb8e1-b50d-4363-95b5-237c40d534c2 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100519 Aug 24 03:58:16.873750 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 395/793] 10.222.0.82 () {58 vars in 1275 bytes} [Wed Aug 24 03:58:16 2022] GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:16.989190 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e7ecefd1-3801-42fe-8ca2-56d6f78d1986 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:16.990560 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e7ecefd1-3801-42fe-8ca2-56d6f78d1986 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:16.996267 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7ecefd1-3801-42fe-8ca2-56d6f78d1986 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:16.996760 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7ecefd1-3801-42fe-8ca2-56d6f78d1986 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:16.997197 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7ecefd1-3801-42fe-8ca2-56d6f78d1986 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:16.997899 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7ecefd1-3801-42fe-8ca2-56d6f78d1986 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:16.998551 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7ecefd1-3801-42fe-8ca2-56d6f78d1986 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:16.998989 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7ecefd1-3801-42fe-8ca2-56d6f78d1986 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:17.146656 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-e7ecefd1-3801-42fe-8ca2-56d6f78d1986 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:17.158683 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-e7ecefd1-3801-42fe-8ca2-56d6f78d1986 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:17.161257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-e7ecefd1-3801-42fe-8ca2-56d6f78d1986 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:17.163104 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e7ecefd1-3801-42fe-8ca2-56d6f78d1986 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1740 microversion: 2.20 time: 0.178942 Aug 24 03:58:17.164287 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 399/794] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:16 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:58:18.191844 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-78d1dec1-5a36-413b-853d-fa8b08d97d70 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:18.194054 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-78d1dec1-5a36-413b-853d-fa8b08d97d70 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:18.206148 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-78d1dec1-5a36-413b-853d-fa8b08d97d70 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:18.209332 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-78d1dec1-5a36-413b-853d-fa8b08d97d70 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:18.209332 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-78d1dec1-5a36-413b-853d-fa8b08d97d70 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:18.210039 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-78d1dec1-5a36-413b-853d-fa8b08d97d70 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:18.210961 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-78d1dec1-5a36-413b-853d-fa8b08d97d70 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:18.211821 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-78d1dec1-5a36-413b-853d-fa8b08d97d70 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:18.491410 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-78d1dec1-5a36-413b-853d-fa8b08d97d70 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:18.522816 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-78d1dec1-5a36-413b-853d-fa8b08d97d70 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:18.524671 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-78d1dec1-5a36-413b-853d-fa8b08d97d70 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:18.525861 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-78d1dec1-5a36-413b-853d-fa8b08d97d70 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1740 microversion: 2.20 time: 0.340717 Aug 24 03:58:18.532638 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 396/795] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:18 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1740 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:18.555068 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-60ea10e5-1066-4403-94e7-23a3347dfbb9 req-24d9d385-7830-4624-989d-afe1dea59d70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66dd80a8-8e33-421c-9c4a-200ad720823a", "tag": "84ac01da-84a3-455a-9de0-78bfa8ece981"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:18.578794 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-60ea10e5-1066-4403-94e7-23a3347dfbb9 req-24d9d385-7830-4624-989d-afe1dea59d70 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:18.580291 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-60ea10e5-1066-4403-94e7-23a3347dfbb9 req-24d9d385-7830-4624-989d-afe1dea59d70 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:18.580744 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-60ea10e5-1066-4403-94e7-23a3347dfbb9 req-24d9d385-7830-4624-989d-afe1dea59d70 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:18.593859 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-60ea10e5-1066-4403-94e7-23a3347dfbb9 req-24d9d385-7830-4624-989d-afe1dea59d70 service nova] Creating event network-changed:84ac01da-84a3-455a-9de0-78bfa8ece981 for instance 66dd80a8-8e33-421c-9c4a-200ad720823a on hv-cinder-85426 Aug 24 03:58:18.600691 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-60ea10e5-1066-4403-94e7-23a3347dfbb9 req-24d9d385-7830-4624-989d-afe1dea59d70 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050202 Aug 24 03:58:18.601912 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 400/796] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:19.552122 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-e267f58f-3170-4b93-b444-6665abdf9345 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:19.552764 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-e267f58f-3170-4b93-b444-6665abdf9345 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:19.564717 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e267f58f-3170-4b93-b444-6665abdf9345 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:19.565208 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e267f58f-3170-4b93-b444-6665abdf9345 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:19.565642 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e267f58f-3170-4b93-b444-6665abdf9345 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:19.566972 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e267f58f-3170-4b93-b444-6665abdf9345 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:19.567605 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e267f58f-3170-4b93-b444-6665abdf9345 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:19.568081 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e267f58f-3170-4b93-b444-6665abdf9345 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:19.774878 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-e267f58f-3170-4b93-b444-6665abdf9345 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:19.785249 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-e267f58f-3170-4b93-b444-6665abdf9345 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:19.787291 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-e267f58f-3170-4b93-b444-6665abdf9345 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:19.788713 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-e267f58f-3170-4b93-b444-6665abdf9345 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1740 microversion: 2.20 time: 0.240726 Aug 24 03:58:19.805920 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 397/797] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:19 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1740 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:20.813965 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-62586037-0cd2-43e3-9327-c3229a2d9313 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:20.814905 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-62586037-0cd2-43e3-9327-c3229a2d9313 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:20.822051 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62586037-0cd2-43e3-9327-c3229a2d9313 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:20.822647 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62586037-0cd2-43e3-9327-c3229a2d9313 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:20.823082 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62586037-0cd2-43e3-9327-c3229a2d9313 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:20.823773 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62586037-0cd2-43e3-9327-c3229a2d9313 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:20.824231 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62586037-0cd2-43e3-9327-c3229a2d9313 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:20.824650 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62586037-0cd2-43e3-9327-c3229a2d9313 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:21.262566 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-62586037-0cd2-43e3-9327-c3229a2d9313 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:21.274157 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-62586037-0cd2-43e3-9327-c3229a2d9313 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:21.279661 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-62586037-0cd2-43e3-9327-c3229a2d9313 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:21.282559 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-62586037-0cd2-43e3-9327-c3229a2d9313 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1740 microversion: 2.20 time: 0.473632 Aug 24 03:58:21.297511 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 401/798] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:20 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1740 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:58:22.264105 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-3e8b1fcd-acaf-4445-a109-56d0fa2f8282 tempest-VolumesTestJSON-877587915 tempest-VolumesTestJSON-877587915-project] Calling method '.version_select at 0x7f155416fca0>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:22.310379 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e074d717-2027-4877-a379-c15a2007a739 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:22.310940 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e074d717-2027-4877-a379-c15a2007a739 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:22.317480 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e074d717-2027-4877-a379-c15a2007a739 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:22.318008 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e074d717-2027-4877-a379-c15a2007a739 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:22.318398 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e074d717-2027-4877-a379-c15a2007a739 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:22.319121 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e074d717-2027-4877-a379-c15a2007a739 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:22.319567 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e074d717-2027-4877-a379-c15a2007a739 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:22.319700 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-3e8b1fcd-acaf-4445-a109-56d0fa2f8282 tempest-VolumesTestJSON-877587915 tempest-VolumesTestJSON-877587915-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/50a96aa3-e3f7-44c3-9ea7-8ff26efd8970" status: 200 len: 351 microversion: 2.1 time: 0.059469 Aug 24 03:58:22.319984 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e074d717-2027-4877-a379-c15a2007a739 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:22.320572 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 398/799] 10.222.0.82 () {58 vars in 1245 bytes} [Wed Aug 24 03:58:22 2022] GET /compute/v2.1/os-volumes/50a96aa3-e3f7-44c3-9ea7-8ff26efd8970 => generated 351 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:22.490849 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-e074d717-2027-4877-a379-c15a2007a739 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:22.500330 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-e074d717-2027-4877-a379-c15a2007a739 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:22.504312 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-e074d717-2027-4877-a379-c15a2007a739 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:22.504312 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e074d717-2027-4877-a379-c15a2007a739 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1740 microversion: 2.20 time: 0.198386 Aug 24 03:58:22.513334 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 402/800] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:22 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1740 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:58:23.533028 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-b9a3013d-2653-4788-ab4e-4279a7f85b3a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:23.536218 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-b9a3013d-2653-4788-ab4e-4279a7f85b3a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:23.550897 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b9a3013d-2653-4788-ab4e-4279a7f85b3a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:23.551552 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b9a3013d-2653-4788-ab4e-4279a7f85b3a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:23.552070 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b9a3013d-2653-4788-ab4e-4279a7f85b3a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:23.552885 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b9a3013d-2653-4788-ab4e-4279a7f85b3a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:23.553417 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b9a3013d-2653-4788-ab4e-4279a7f85b3a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:23.553940 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b9a3013d-2653-4788-ab4e-4279a7f85b3a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:23.701060 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-b9a3013d-2653-4788-ab4e-4279a7f85b3a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:23.709784 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-b9a3013d-2653-4788-ab4e-4279a7f85b3a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:23.711460 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-b9a3013d-2653-4788-ab4e-4279a7f85b3a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:23.712751 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-b9a3013d-2653-4788-ab4e-4279a7f85b3a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1740 microversion: 2.20 time: 0.187428 Aug 24 03:58:23.713363 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 399/801] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:23 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:23.887785 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-64d66859-8e77-41ac-936e-41d05dbc8c20 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:23.888295 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-64d66859-8e77-41ac-936e-41d05dbc8c20 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: a362c623-fa9a-4da0-b8f5-64233f2651ba] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:23.894395 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-64d66859-8e77-41ac-936e-41d05dbc8c20 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:23.895194 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-64d66859-8e77-41ac-936e-41d05dbc8c20 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:23.895637 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-64d66859-8e77-41ac-936e-41d05dbc8c20 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:23.896337 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-64d66859-8e77-41ac-936e-41d05dbc8c20 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:23.896796 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-64d66859-8e77-41ac-936e-41d05dbc8c20 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:23.897395 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-64d66859-8e77-41ac-936e-41d05dbc8c20 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:23.923003 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-64d66859-8e77-41ac-936e-41d05dbc8c20 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba/ips" status: 200 len: 145 microversion: 2.1 time: 0.040642 Aug 24 03:58:23.935159 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 403/802] 10.222.0.82 () {58 vars in 1248 bytes} [Wed Aug 24 03:58:23 2022] GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:23.965151 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-04432d86-72ec-4a55-8794-01c6d296018d tempest-VolumesTestJSON-877587915 tempest-VolumesTestJSON-877587915-project] Calling method '.version_select at 0x7f15541d00d0>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:24.025964 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-04432d86-72ec-4a55-8794-01c6d296018d tempest-VolumesTestJSON-877587915 tempest-VolumesTestJSON-877587915-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/754139a9-45a6-4286-91bb-b122667ecad1" status: 200 len: 350 microversion: 2.1 time: 0.064636 Aug 24 03:58:24.026659 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 400/803] 10.222.0.82 () {58 vars in 1245 bytes} [Wed Aug 24 03:58:23 2022] GET /compute/v2.1/os-volumes/754139a9-45a6-4286-91bb-b122667ecad1 => generated 350 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:24.745817 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-54e8754a-e35d-40a0-a8a5-59fce554306f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:24.746484 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-54e8754a-e35d-40a0-a8a5-59fce554306f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:24.756526 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54e8754a-e35d-40a0-a8a5-59fce554306f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:24.757096 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54e8754a-e35d-40a0-a8a5-59fce554306f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:24.758103 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54e8754a-e35d-40a0-a8a5-59fce554306f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:24.759087 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54e8754a-e35d-40a0-a8a5-59fce554306f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:24.759549 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54e8754a-e35d-40a0-a8a5-59fce554306f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:24.760494 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-54e8754a-e35d-40a0-a8a5-59fce554306f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:24.912360 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-54e8754a-e35d-40a0-a8a5-59fce554306f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:24.920617 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-54e8754a-e35d-40a0-a8a5-59fce554306f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:24.928094 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-54e8754a-e35d-40a0-a8a5-59fce554306f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:24.928094 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-54e8754a-e35d-40a0-a8a5-59fce554306f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1740 microversion: 2.20 time: 0.184021 Aug 24 03:58:24.928094 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 404/804] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:24 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:25.732505 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-cfee4da2-79c0-4eed-8aac-3f1aae9357ed tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ebc223d-cc59-4e75-8834-b0c1c6530ab7"}} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:25.734934 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-cfee4da2-79c0-4eed-8aac-3f1aae9357ed tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: a362c623-fa9a-4da0-b8f5-64233f2651ba] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:25.741399 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cfee4da2-79c0-4eed-8aac-3f1aae9357ed tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:25.741873 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cfee4da2-79c0-4eed-8aac-3f1aae9357ed tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:25.742305 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cfee4da2-79c0-4eed-8aac-3f1aae9357ed tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:25.743013 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cfee4da2-79c0-4eed-8aac-3f1aae9357ed tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:25.743457 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cfee4da2-79c0-4eed-8aac-3f1aae9357ed tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:25.743870 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cfee4da2-79c0-4eed-8aac-3f1aae9357ed tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:25.921787 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c4960a64-b562-4ed1-b0cc-3ccb8df02573 tempest-VolumesTestJSON-877587915 tempest-VolumesTestJSON-877587915-project] Calling method '.version_select at 0x7f1547faee50>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:25.971783 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c4960a64-b562-4ed1-b0cc-3ccb8df02573 tempest-VolumesTestJSON-877587915 tempest-VolumesTestJSON-877587915-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/96e3192a-817a-4894-a8c7-701c735871fc" status: 200 len: 351 microversion: 2.1 time: 0.053713 Aug 24 03:58:25.980064 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 405/805] 10.222.0.82 () {58 vars in 1245 bytes} [Wed Aug 24 03:58:25 2022] GET /compute/v2.1/os-volumes/96e3192a-817a-4894-a8c7-701c735871fc => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:58:25.984727 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7ba97a31-3abd-444d-b92c-aace3d451b9e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:25.984965 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7ba97a31-3abd-444d-b92c-aace3d451b9e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:25.993659 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ba97a31-3abd-444d-b92c-aace3d451b9e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:25.994184 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ba97a31-3abd-444d-b92c-aace3d451b9e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:25.994663 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ba97a31-3abd-444d-b92c-aace3d451b9e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:25.995366 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ba97a31-3abd-444d-b92c-aace3d451b9e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:25.995817 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ba97a31-3abd-444d-b92c-aace3d451b9e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:25.996270 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7ba97a31-3abd-444d-b92c-aace3d451b9e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:26.149288 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-7ba97a31-3abd-444d-b92c-aace3d451b9e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:26.158742 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-7ba97a31-3abd-444d-b92c-aace3d451b9e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:26.160474 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-7ba97a31-3abd-444d-b92c-aace3d451b9e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:26.161738 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7ba97a31-3abd-444d-b92c-aace3d451b9e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1722 microversion: 2.20 time: 0.188472 Aug 24 03:58:26.197049 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 406/806] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:25 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:26.202154 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-759eea3b-f909-41e3-b626-146df9e553dc tempest-VolumesTestJSON-877587915 tempest-VolumesTestJSON-877587915-project] Calling method '.version_select at 0x7f1547fae790>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:26.294179 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-759eea3b-f909-41e3-b626-146df9e553dc tempest-VolumesTestJSON-877587915 tempest-VolumesTestJSON-877587915-project] 10.222.0.82 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.095873 Aug 24 03:58:26.295054 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 407/807] 10.222.0.82 () {58 vars in 1134 bytes} [Wed Aug 24 03:58:26 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:26.310045 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6ae932bb-bd85-4fb4-851f-bd728f87efe7 tempest-VolumesTestJSON-877587915 tempest-VolumesTestJSON-877587915-project] Calling method '.version_select at 0x7f1554145b80>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:26.413837 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6ae932bb-bd85-4fb4-851f-bd728f87efe7 tempest-VolumesTestJSON-877587915 tempest-VolumesTestJSON-877587915-project] 10.222.0.82 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.107533 Aug 24 03:58:26.413837 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 408/808] 10.222.0.82 () {58 vars in 1149 bytes} [Wed Aug 24 03:58:26 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:26.427098 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-10d808a1-5506-44d6-a023-4ead2231a7a7 tempest-VolumesTestJSON-877587915 tempest-VolumesTestJSON-877587915-project] Calling method '.version_select at 0x7f1547fc3700>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:26.511819 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-10d808a1-5506-44d6-a023-4ead2231a7a7 tempest-VolumesTestJSON-877587915 tempest-VolumesTestJSON-877587915-project] 10.222.0.82 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.089200 Aug 24 03:58:26.512392 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 409/809] 10.222.0.82 () {58 vars in 1134 bytes} [Wed Aug 24 03:58:26 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:58:26.524636 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a5c3385f-90d8-4ebd-92a6-7cedd0985a49 tempest-VolumesTestJSON-877587915 tempest-VolumesTestJSON-877587915-project] Calling method '.version_select at 0x7f1554145310>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:26.608244 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a5c3385f-90d8-4ebd-92a6-7cedd0985a49 tempest-VolumesTestJSON-877587915 tempest-VolumesTestJSON-877587915-project] 10.222.0.82 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.087173 Aug 24 03:58:26.608880 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 410/810] 10.222.0.82 () {58 vars in 1167 bytes} [Wed Aug 24 03:58:26 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:58:26.621853 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-94e0b3e1-c7c4-401e-a545-d9c30be35252 tempest-VolumesTestJSON-877587915 tempest-VolumesTestJSON-877587915-project] Calling method '.version_select at 0x7f1547faeca0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:26.708045 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-94e0b3e1-c7c4-401e-a545-d9c30be35252 tempest-VolumesTestJSON-877587915 tempest-VolumesTestJSON-877587915-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.089801 Aug 24 03:58:26.708641 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 411/811] 10.222.0.82 () {58 vars in 1170 bytes} [Wed Aug 24 03:58:26 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:58:26.721212 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-962476c2-710e-42b4-bb4b-0082d236d0d7 tempest-VolumesTestJSON-877587915 tempest-VolumesTestJSON-877587915-project] Calling method '.version_select at 0x7f15541ce040>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:26.732897 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-cfee4da2-79c0-4eed-8aac-3f1aae9357ed tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "POST /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.004688 Aug 24 03:58:26.733734 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 401/812] 10.222.0.82 () {60 vars in 1323 bytes} [Wed Aug 24 03:58:25 2022] POST /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba/os-volume_attachments => generated 194 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:58:26.812905 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-962476c2-710e-42b4-bb4b-0082d236d0d7 tempest-VolumesTestJSON-877587915 tempest-VolumesTestJSON-877587915-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.095137 Aug 24 03:58:26.813568 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 412/813] 10.222.0.82 () {58 vars in 1155 bytes} [Wed Aug 24 03:58:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:58:26.827615 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-de58d1fd-7cfc-44cb-a1fd-4d6196b71128 tempest-VolumesTestJSON-877587915 tempest-VolumesTestJSON-877587915-project] Calling method '.version_select at 0x7f1554175f70>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:26.914448 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-de58d1fd-7cfc-44cb-a1fd-4d6196b71128 tempest-VolumesTestJSON-877587915 tempest-VolumesTestJSON-877587915-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.090838 Aug 24 03:58:26.915049 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 402/814] 10.222.0.82 () {58 vars in 1188 bytes} [Wed Aug 24 03:58:26 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:26.927694 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4d32ef9e-0a83-44f9-b400-0738773673a5 tempest-VolumesTestJSON-877587915 tempest-VolumesTestJSON-877587915-project] Calling method '.version_select at 0x7f15541d0dc0>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:27.012307 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4d32ef9e-0a83-44f9-b400-0738773673a5 tempest-VolumesTestJSON-877587915 tempest-VolumesTestJSON-877587915-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.088295 Aug 24 03:58:27.012935 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 413/815] 10.222.0.82 () {58 vars in 1155 bytes} [Wed Aug 24 03:58:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:27.190333 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-46f862b8-7078-4275-9c44-edf1e00c0432 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:27.191721 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-46f862b8-7078-4275-9c44-edf1e00c0432 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:27.198909 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-46f862b8-7078-4275-9c44-edf1e00c0432 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:27.199380 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-46f862b8-7078-4275-9c44-edf1e00c0432 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:27.199807 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-46f862b8-7078-4275-9c44-edf1e00c0432 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:27.200512 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-46f862b8-7078-4275-9c44-edf1e00c0432 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:27.200951 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-46f862b8-7078-4275-9c44-edf1e00c0432 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:27.201362 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-46f862b8-7078-4275-9c44-edf1e00c0432 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:27.344306 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-46f862b8-7078-4275-9c44-edf1e00c0432 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:27.352592 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-46f862b8-7078-4275-9c44-edf1e00c0432 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:27.354188 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-46f862b8-7078-4275-9c44-edf1e00c0432 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:27.355481 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-46f862b8-7078-4275-9c44-edf1e00c0432 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1722 microversion: 2.20 time: 0.169430 Aug 24 03:58:27.356036 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 403/816] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:27 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:28.380095 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-591dd9d4-4e46-4242-ae96-8ac98e844be2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:28.387562 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-591dd9d4-4e46-4242-ae96-8ac98e844be2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:28.387562 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-591dd9d4-4e46-4242-ae96-8ac98e844be2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:28.387982 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-591dd9d4-4e46-4242-ae96-8ac98e844be2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:28.388278 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-591dd9d4-4e46-4242-ae96-8ac98e844be2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:28.389074 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-591dd9d4-4e46-4242-ae96-8ac98e844be2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:28.389532 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-591dd9d4-4e46-4242-ae96-8ac98e844be2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:28.389959 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-591dd9d4-4e46-4242-ae96-8ac98e844be2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:28.528974 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-591dd9d4-4e46-4242-ae96-8ac98e844be2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:28.537037 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-591dd9d4-4e46-4242-ae96-8ac98e844be2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:28.538693 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-591dd9d4-4e46-4242-ae96-8ac98e844be2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:28.539856 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-591dd9d4-4e46-4242-ae96-8ac98e844be2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1722 microversion: 2.20 time: 0.165132 Aug 24 03:58:28.540414 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 414/817] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:28 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:29.561960 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-545da7b5-21d1-48ab-8b98-2639e109978a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:29.563394 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-545da7b5-21d1-48ab-8b98-2639e109978a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:29.570222 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-545da7b5-21d1-48ab-8b98-2639e109978a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:29.570736 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-545da7b5-21d1-48ab-8b98-2639e109978a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:29.571171 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-545da7b5-21d1-48ab-8b98-2639e109978a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:29.571868 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-545da7b5-21d1-48ab-8b98-2639e109978a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:29.572323 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-545da7b5-21d1-48ab-8b98-2639e109978a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:29.572745 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-545da7b5-21d1-48ab-8b98-2639e109978a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:29.688870 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-dfb3a58c-5677-4a15-966c-67cfa3b2d737 req-8ded28a7-71d1-4c2c-adeb-ae43cb3e58dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df85e6fe-54b4-456b-875d-7c3b6418c40e", "name": "network-vif-unplugged", "status": "completed", "tag": "b70bff9a-be9c-4b03-8c48-2151d8730e62"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:29.700808 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-dfb3a58c-5677-4a15-966c-67cfa3b2d737 req-8ded28a7-71d1-4c2c-adeb-ae43cb3e58dc service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:29.701372 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-dfb3a58c-5677-4a15-966c-67cfa3b2d737 req-8ded28a7-71d1-4c2c-adeb-ae43cb3e58dc service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:29.702072 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-dfb3a58c-5677-4a15-966c-67cfa3b2d737 req-8ded28a7-71d1-4c2c-adeb-ae43cb3e58dc service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:29.713404 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.compute.server_external_events [req-dfb3a58c-5677-4a15-966c-67cfa3b2d737 req-8ded28a7-71d1-4c2c-adeb-ae43cb3e58dc service nova] Unable to find a host for instance df85e6fe-54b4-456b-875d-7c3b6418c40e. Dropping event network-vif-unplugged {{(pid=127870) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 03:58:29.714231 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-dfb3a58c-5677-4a15-966c-67cfa3b2d737 req-8ded28a7-71d1-4c2c-adeb-ae43cb3e58dc service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029952 Aug 24 03:58:29.715010 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 415/818] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 24 03:58:29.717638 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-545da7b5-21d1-48ab-8b98-2639e109978a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:29.725707 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-545da7b5-21d1-48ab-8b98-2639e109978a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:29.727225 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-545da7b5-21d1-48ab-8b98-2639e109978a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:29.728462 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-545da7b5-21d1-48ab-8b98-2639e109978a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1665 microversion: 2.20 time: 0.170447 Aug 24 03:58:29.729017 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 404/819] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:29 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1665 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:29.752062 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-01f16c4e-0a67-4519-a940-6312f6a87d74 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea897db2-efee-46a2-9609-682878031df6"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:29.755637 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-01f16c4e-0a67-4519-a940-6312f6a87d74 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:29.761711 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-01f16c4e-0a67-4519-a940-6312f6a87d74 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:29.762192 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-01f16c4e-0a67-4519-a940-6312f6a87d74 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:29.762851 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-01f16c4e-0a67-4519-a940-6312f6a87d74 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:29.763581 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-01f16c4e-0a67-4519-a940-6312f6a87d74 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:29.764222 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-01f16c4e-0a67-4519-a940-6312f6a87d74 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:29.764652 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-01f16c4e-0a67-4519-a940-6312f6a87d74 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:30.962239 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-01f16c4e-0a67-4519-a940-6312f6a87d74 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "POST /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.214361 Aug 24 03:58:30.962895 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 416/820] 10.222.0.82 () {62 vars in 1364 bytes} [Wed Aug 24 03:58:29 2022] POST /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e/os-volume_attachments => generated 188 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:58:31.104627 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-b3bc03e3-cd1f-401d-b70d-d51d5b1d674f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:31.105138 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-b3bc03e3-cd1f-401d-b70d-d51d5b1d674f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:31.107482 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_api:SELECT=52 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:31.112575 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b3bc03e3-cd1f-401d-b70d-d51d5b1d674f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:31.117851 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b3bc03e3-cd1f-401d-b70d-d51d5b1d674f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:31.117851 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b3bc03e3-cd1f-401d-b70d-d51d5b1d674f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:31.117851 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b3bc03e3-cd1f-401d-b70d-d51d5b1d674f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:31.117851 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b3bc03e3-cd1f-401d-b70d-d51d5b1d674f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:31.118239 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b3bc03e3-cd1f-401d-b70d-d51d5b1d674f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:31.779385 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-b3bc03e3-cd1f-401d-b70d-d51d5b1d674f tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "DELETE /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e/os-volume_attachments/ea897db2-efee-46a2-9609-682878031df6" status: 202 len: 0 microversion: 2.20 time: 0.678640 Aug 24 03:58:31.779989 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 405/821] 10.222.0.82 () {60 vars in 1457 bytes} [Wed Aug 24 03:58:31 2022] DELETE /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e/os-volume_attachments/ea897db2-efee-46a2-9609-682878031df6 => generated 0 bytes in 680 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:58:31.850802 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4e791a70-6313-4d9d-9876-328ec54157b3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:31.851402 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4e791a70-6313-4d9d-9876-328ec54157b3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:31.858549 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4e791a70-6313-4d9d-9876-328ec54157b3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:31.859042 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4e791a70-6313-4d9d-9876-328ec54157b3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:31.859478 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4e791a70-6313-4d9d-9876-328ec54157b3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:31.860173 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4e791a70-6313-4d9d-9876-328ec54157b3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:31.860628 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4e791a70-6313-4d9d-9876-328ec54157b3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:31.861053 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4e791a70-6313-4d9d-9876-328ec54157b3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:31.892003 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4e791a70-6313-4d9d-9876-328ec54157b3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127870) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 03:58:32.262634 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4e791a70-6313-4d9d-9876-328ec54157b3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "POST /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e/action" status: 202 len: 0 microversion: 2.20 time: 0.416858 Aug 24 03:58:32.263280 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 417/822] 10.222.0.82 () {62 vars in 1319 bytes} [Wed Aug 24 03:58:31 2022] POST /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e/action => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:58:32.272891 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-73a04606-2efb-4338-a9ad-3538bfac3dfc tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:32.273491 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-73a04606-2efb-4338-a9ad-3538bfac3dfc tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:32.280345 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-73a04606-2efb-4338-a9ad-3538bfac3dfc tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:32.280821 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-73a04606-2efb-4338-a9ad-3538bfac3dfc tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:32.286160 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-73a04606-2efb-4338-a9ad-3538bfac3dfc tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:32.286160 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-73a04606-2efb-4338-a9ad-3538bfac3dfc tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:32.286160 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-73a04606-2efb-4338-a9ad-3538bfac3dfc tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:32.286160 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-73a04606-2efb-4338-a9ad-3538bfac3dfc tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:32.445385 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-73a04606-2efb-4338-a9ad-3538bfac3dfc tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:32.461505 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-73a04606-2efb-4338-a9ad-3538bfac3dfc tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:32.465080 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-73a04606-2efb-4338-a9ad-3538bfac3dfc tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:32.469021 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-73a04606-2efb-4338-a9ad-3538bfac3dfc tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1673 microversion: 2.20 time: 0.200879 Aug 24 03:58:32.470348 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 406/823] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:32 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1673 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:33.496308 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-243426ce-604f-4343-918b-ac98e4e6c3b5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:33.497577 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-243426ce-604f-4343-918b-ac98e4e6c3b5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:33.505293 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-243426ce-604f-4343-918b-ac98e4e6c3b5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:33.506023 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-243426ce-604f-4343-918b-ac98e4e6c3b5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:33.506477 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-243426ce-604f-4343-918b-ac98e4e6c3b5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:33.508809 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-243426ce-604f-4343-918b-ac98e4e6c3b5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:33.508809 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-243426ce-604f-4343-918b-ac98e4e6c3b5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:33.508809 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-243426ce-604f-4343-918b-ac98e4e6c3b5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:33.648014 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-243426ce-604f-4343-918b-ac98e4e6c3b5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:33.651560 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:33.656689 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-243426ce-604f-4343-918b-ac98e4e6c3b5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:33.658289 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-243426ce-604f-4343-918b-ac98e4e6c3b5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:33.660114 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-243426ce-604f-4343-918b-ac98e4e6c3b5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1673 microversion: 2.20 time: 0.169874 Aug 24 03:58:33.660680 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 418/824] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:33 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1673 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:34.683784 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-e6b5c12d-b63f-4f87-8551-c5e84c1a7349 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:34.684399 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-e6b5c12d-b63f-4f87-8551-c5e84c1a7349 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:34.692586 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e6b5c12d-b63f-4f87-8551-c5e84c1a7349 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:34.692586 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e6b5c12d-b63f-4f87-8551-c5e84c1a7349 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:34.692586 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e6b5c12d-b63f-4f87-8551-c5e84c1a7349 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:34.692921 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e6b5c12d-b63f-4f87-8551-c5e84c1a7349 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:34.693291 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e6b5c12d-b63f-4f87-8551-c5e84c1a7349 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:34.693716 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e6b5c12d-b63f-4f87-8551-c5e84c1a7349 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:34.710366 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:34.827424 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-e6b5c12d-b63f-4f87-8551-c5e84c1a7349 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:34.836396 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-e6b5c12d-b63f-4f87-8551-c5e84c1a7349 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:34.837894 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-e6b5c12d-b63f-4f87-8551-c5e84c1a7349 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:34.839106 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-e6b5c12d-b63f-4f87-8551-c5e84c1a7349 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1731 microversion: 2.20 time: 0.159613 Aug 24 03:58:34.839654 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 407/825] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:34 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:35.864164 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1f6d4618-10be-4623-b298-b64bea41b71c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:35.865006 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1f6d4618-10be-4623-b298-b64bea41b71c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:35.872383 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1f6d4618-10be-4623-b298-b64bea41b71c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:35.872928 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1f6d4618-10be-4623-b298-b64bea41b71c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:35.873445 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1f6d4618-10be-4623-b298-b64bea41b71c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:35.874224 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1f6d4618-10be-4623-b298-b64bea41b71c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:35.874810 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1f6d4618-10be-4623-b298-b64bea41b71c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:35.875239 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1f6d4618-10be-4623-b298-b64bea41b71c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:36.026732 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-1f6d4618-10be-4623-b298-b64bea41b71c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:36.035629 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-1f6d4618-10be-4623-b298-b64bea41b71c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:36.037149 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-1f6d4618-10be-4623-b298-b64bea41b71c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:36.041540 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1f6d4618-10be-4623-b298-b64bea41b71c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1731 microversion: 2.20 time: 0.179279 Aug 24 03:58:36.041540 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 419/826] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:35 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:36.426897 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-916d79fd-542f-49d5-a3cc-0b7c3ce44124 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:36.431009 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-916d79fd-542f-49d5-a3cc-0b7c3ce44124 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: a362c623-fa9a-4da0-b8f5-64233f2651ba] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:36.436187 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-916d79fd-542f-49d5-a3cc-0b7c3ce44124 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:36.436659 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-916d79fd-542f-49d5-a3cc-0b7c3ce44124 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:36.437084 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-916d79fd-542f-49d5-a3cc-0b7c3ce44124 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:36.437759 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-916d79fd-542f-49d5-a3cc-0b7c3ce44124 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:36.438204 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-916d79fd-542f-49d5-a3cc-0b7c3ce44124 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:36.438650 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-916d79fd-542f-49d5-a3cc-0b7c3ce44124 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:36.468122 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-916d79fd-542f-49d5-a3cc-0b7c3ce44124 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045841 Aug 24 03:58:36.468703 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 408/827] 10.222.0.82 () {58 vars in 1302 bytes} [Wed Aug 24 03:58:36 2022] GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:36.479774 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-804794f4-91a3-40f2-ab99-42b34274b929 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:36.480411 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-804794f4-91a3-40f2-ab99-42b34274b929 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: a362c623-fa9a-4da0-b8f5-64233f2651ba] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:36.488710 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-804794f4-91a3-40f2-ab99-42b34274b929 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:36.488710 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-804794f4-91a3-40f2-ab99-42b34274b929 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:36.489039 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-804794f4-91a3-40f2-ab99-42b34274b929 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:36.489762 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-804794f4-91a3-40f2-ab99-42b34274b929 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:36.490224 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-804794f4-91a3-40f2-ab99-42b34274b929 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:36.490718 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-804794f4-91a3-40f2-ab99-42b34274b929 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:36.531070 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-804794f4-91a3-40f2-ab99-42b34274b929 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba/os-volume_attachments/3ebc223d-cc59-4e75-8834-b0c1c6530ab7" status: 200 len: 194 microversion: 2.1 time: 0.055518 Aug 24 03:58:36.531680 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 420/828] 10.222.0.82 () {58 vars in 1413 bytes} [Wed Aug 24 03:58:36 2022] GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba/os-volume_attachments/3ebc223d-cc59-4e75-8834-b0c1c6530ab7 => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:37.077083 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-792bff43-25aa-4577-8032-b5264b59d703 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:37.078804 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-792bff43-25aa-4577-8032-b5264b59d703 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:37.089493 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-792bff43-25aa-4577-8032-b5264b59d703 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:37.090331 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-792bff43-25aa-4577-8032-b5264b59d703 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:37.091398 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-792bff43-25aa-4577-8032-b5264b59d703 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:37.092459 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-792bff43-25aa-4577-8032-b5264b59d703 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:37.093105 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-792bff43-25aa-4577-8032-b5264b59d703 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:37.093688 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-792bff43-25aa-4577-8032-b5264b59d703 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:37.303994 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-792bff43-25aa-4577-8032-b5264b59d703 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:37.319656 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-792bff43-25aa-4577-8032-b5264b59d703 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:37.321465 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-792bff43-25aa-4577-8032-b5264b59d703 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:37.322859 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-792bff43-25aa-4577-8032-b5264b59d703 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1731 microversion: 2.20 time: 0.264243 Aug 24 03:58:37.341065 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 409/829] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:37 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1731 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:38.220553 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ad465ecd-d570-487a-bf46-2bbcc7985c1a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c29dd358-aca7-49b3-93fc-623bb2738670"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:38.224461 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ad465ecd-d570-487a-bf46-2bbcc7985c1a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: a362c623-fa9a-4da0-b8f5-64233f2651ba] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:38.232705 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad465ecd-d570-487a-bf46-2bbcc7985c1a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:38.240761 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad465ecd-d570-487a-bf46-2bbcc7985c1a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:38.240761 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad465ecd-d570-487a-bf46-2bbcc7985c1a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:38.240761 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad465ecd-d570-487a-bf46-2bbcc7985c1a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:38.240761 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad465ecd-d570-487a-bf46-2bbcc7985c1a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:38.242389 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ad465ecd-d570-487a-bf46-2bbcc7985c1a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:38.347908 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-948e257a-ce40-41c2-95aa-0e919aed2201 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:38.348763 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-948e257a-ce40-41c2-95aa-0e919aed2201 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:38.355975 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-948e257a-ce40-41c2-95aa-0e919aed2201 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:38.356543 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-948e257a-ce40-41c2-95aa-0e919aed2201 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:38.357047 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-948e257a-ce40-41c2-95aa-0e919aed2201 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:38.357935 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-948e257a-ce40-41c2-95aa-0e919aed2201 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:38.358707 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-948e257a-ce40-41c2-95aa-0e919aed2201 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:38.359283 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-948e257a-ce40-41c2-95aa-0e919aed2201 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:38.521200 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-948e257a-ce40-41c2-95aa-0e919aed2201 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:38.532840 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-948e257a-ce40-41c2-95aa-0e919aed2201 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:38.535070 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-948e257a-ce40-41c2-95aa-0e919aed2201 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:38.536246 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-948e257a-ce40-41c2-95aa-0e919aed2201 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1731 microversion: 2.20 time: 0.192352 Aug 24 03:58:38.541051 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 410/830] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:38 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1731 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:58:39.567581 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-6ac151b7-a053-4370-bed2-b5fe5aa5a313 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:39.568412 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-6ac151b7-a053-4370-bed2-b5fe5aa5a313 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:39.574730 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6ac151b7-a053-4370-bed2-b5fe5aa5a313 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:39.575217 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6ac151b7-a053-4370-bed2-b5fe5aa5a313 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:39.575784 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6ac151b7-a053-4370-bed2-b5fe5aa5a313 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:39.576480 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6ac151b7-a053-4370-bed2-b5fe5aa5a313 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:39.576933 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6ac151b7-a053-4370-bed2-b5fe5aa5a313 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:39.577474 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6ac151b7-a053-4370-bed2-b5fe5aa5a313 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:39.741789 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-6ac151b7-a053-4370-bed2-b5fe5aa5a313 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:39.751182 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-6ac151b7-a053-4370-bed2-b5fe5aa5a313 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:39.753723 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-6ac151b7-a053-4370-bed2-b5fe5aa5a313 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:39.755117 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-6ac151b7-a053-4370-bed2-b5fe5aa5a313 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1731 microversion: 2.20 time: 0.192029 Aug 24 03:58:39.756035 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 411/831] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:39 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1731 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:58:39.762451 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-e5da05e9-717d-4405-86df-85979b8f902b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-238662820", "imageRef": "c32522f7-22a8-45d4-a51e-f17637def2e1", "flavorRef": "452", "networks": [{"uuid": "95c2c737-2f6c-4c40-b04c-f6d97ffe7eda"}]}} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:39.822364 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.network.neutron [None req-e5da05e9-717d-4405-86df-85979b8f902b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] validate_networks() for [('95c2c737-2f6c-4c40-b04c-f6d97ffe7eda', None, None, None, None, None)] {{(pid=127869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:58:40.263550 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-e5da05e9-717d-4405-86df-85979b8f902b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Flavor limits 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:58:40.263994 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-e5da05e9-717d-4405-86df-85979b8f902b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Image limits 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:58:40.264460 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-e5da05e9-717d-4405-86df-85979b8f902b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Flavor pref 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:58:40.264860 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-e5da05e9-717d-4405-86df-85979b8f902b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Image pref 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:58:40.265303 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-e5da05e9-717d-4405-86df-85979b8f902b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:58:40.275967 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e5da05e9-717d-4405-86df-85979b8f902b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:40.276598 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e5da05e9-717d-4405-86df-85979b8f902b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:40.277150 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e5da05e9-717d-4405-86df-85979b8f902b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:40.277980 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e5da05e9-717d-4405-86df-85979b8f902b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:40.278554 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e5da05e9-717d-4405-86df-85979b8f902b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:40.279076 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e5da05e9-717d-4405-86df-85979b8f902b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:40.296999 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.quota [None req-e5da05e9-717d-4405-86df-85979b8f902b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Getting quotas for project 6e3d57c8abbd49e69c0caad57f7f9815. Resources: {'instances', 'cores', 'ram'} {{(pid=127869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:58:40.301932 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.quota [None req-e5da05e9-717d-4405-86df-85979b8f902b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Getting quotas for user 2206cb5005354ab4a716efb525c633e7 and project 6e3d57c8abbd49e69c0caad57f7f9815. Resources: {'instances', 'cores', 'ram'} {{(pid=127869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:58:40.318475 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-e5da05e9-717d-4405-86df-85979b8f902b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Going to run 1 instances... {{(pid=127869) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:58:40.320913 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-e5da05e9-717d-4405-86df-85979b8f902b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 6052f56c-fecc-42d7-a99a-e192c776be59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c32522f7-22a8-45d4-a51e-f17637def2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:58:40.466076 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-e5da05e9-717d-4405-86df-85979b8f902b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.707312 Aug 24 03:58:40.468739 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 412/832] 10.222.0.82 () {60 vars in 1147 bytes} [Wed Aug 24 03:58:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:58:40.480034 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-f1b5b59f-ed32-4b38-98f2-85c52f894053 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:40.480652 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-f1b5b59f-ed32-4b38-98f2-85c52f894053 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 6052f56c-fecc-42d7-a99a-e192c776be59] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:40.540863 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-f1b5b59f-ed32-4b38-98f2-85c52f894053 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206cb5005354ab4a716efb525c633e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3d57c8abbd49e69c0caad57f7f9815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:40.550992 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-f1b5b59f-ed32-4b38-98f2-85c52f894053 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59" status: 200 len: 1218 microversion: 2.1 time: 0.074967 Aug 24 03:58:40.551498 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 413/833] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:40 2022] GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59 => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:58:40.779910 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-eccf4165-7003-45e0-942b-d5bca9e1b7e1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:40.781481 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-eccf4165-7003-45e0-942b-d5bca9e1b7e1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:40.795289 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-eccf4165-7003-45e0-942b-d5bca9e1b7e1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:40.795289 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-eccf4165-7003-45e0-942b-d5bca9e1b7e1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:40.795289 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-eccf4165-7003-45e0-942b-d5bca9e1b7e1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:40.795289 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-eccf4165-7003-45e0-942b-d5bca9e1b7e1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:40.795779 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-eccf4165-7003-45e0-942b-d5bca9e1b7e1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:40.795779 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-eccf4165-7003-45e0-942b-d5bca9e1b7e1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:40.946204 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-eccf4165-7003-45e0-942b-d5bca9e1b7e1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:40.955323 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-eccf4165-7003-45e0-942b-d5bca9e1b7e1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:40.957447 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-eccf4165-7003-45e0-942b-d5bca9e1b7e1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:40.958653 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-eccf4165-7003-45e0-942b-d5bca9e1b7e1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1731 microversion: 2.20 time: 0.182885 Aug 24 03:58:40.959391 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 414/834] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:40 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1731 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:58:41.572051 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-ba88ef97-092a-41f3-9561-b12077f3e315 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:41.572662 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-ba88ef97-092a-41f3-9561-b12077f3e315 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 6052f56c-fecc-42d7-a99a-e192c776be59] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:41.630816 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-ba88ef97-092a-41f3-9561-b12077f3e315 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206cb5005354ab4a716efb525c633e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3d57c8abbd49e69c0caad57f7f9815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:41.638227 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-ba88ef97-092a-41f3-9561-b12077f3e315 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59" status: 200 len: 1218 microversion: 2.1 time: 0.070241 Aug 24 03:58:41.638835 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 415/835] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:41 2022] GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59 => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:58:41.984192 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-8e2d4853-be24-4444-9c19-b997b37f13e9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:41.984879 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-8e2d4853-be24-4444-9c19-b997b37f13e9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:41.993889 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8e2d4853-be24-4444-9c19-b997b37f13e9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:41.994388 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8e2d4853-be24-4444-9c19-b997b37f13e9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:41.994909 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8e2d4853-be24-4444-9c19-b997b37f13e9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:41.995674 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8e2d4853-be24-4444-9c19-b997b37f13e9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:41.996183 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8e2d4853-be24-4444-9c19-b997b37f13e9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:41.996670 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8e2d4853-be24-4444-9c19-b997b37f13e9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:42.133669 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-8e2d4853-be24-4444-9c19-b997b37f13e9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:42.142677 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-8e2d4853-be24-4444-9c19-b997b37f13e9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:42.144809 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-8e2d4853-be24-4444-9c19-b997b37f13e9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:42.146025 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-8e2d4853-be24-4444-9c19-b997b37f13e9 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1731 microversion: 2.20 time: 0.166922 Aug 24 03:58:42.147680 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 416/836] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:41 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:42.659875 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-73fffaec-e9d8-4316-8d67-d9d52f5587c5 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:42.660484 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-73fffaec-e9d8-4316-8d67-d9d52f5587c5 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 6052f56c-fecc-42d7-a99a-e192c776be59] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:42.666854 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-73fffaec-e9d8-4316-8d67-d9d52f5587c5 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:42.667345 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-73fffaec-e9d8-4316-8d67-d9d52f5587c5 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:42.667801 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-73fffaec-e9d8-4316-8d67-d9d52f5587c5 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:42.668486 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-73fffaec-e9d8-4316-8d67-d9d52f5587c5 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:42.668936 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-73fffaec-e9d8-4316-8d67-d9d52f5587c5 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:42.669356 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-73fffaec-e9d8-4316-8d67-d9d52f5587c5 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:42.740665 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-73fffaec-e9d8-4316-8d67-d9d52f5587c5 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206cb5005354ab4a716efb525c633e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3d57c8abbd49e69c0caad57f7f9815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:42.748676 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-73fffaec-e9d8-4316-8d67-d9d52f5587c5 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59" status: 200 len: 1222 microversion: 2.1 time: 0.092769 Aug 24 03:58:42.749252 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 417/837] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:42 2022] GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59 => generated 1222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:58:43.170851 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-aef82bee-1b8b-4acd-94af-24b82b677199 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:43.171561 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-aef82bee-1b8b-4acd-94af-24b82b677199 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:43.178355 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-aef82bee-1b8b-4acd-94af-24b82b677199 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:43.178867 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-aef82bee-1b8b-4acd-94af-24b82b677199 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:43.179301 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-aef82bee-1b8b-4acd-94af-24b82b677199 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:43.179996 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-aef82bee-1b8b-4acd-94af-24b82b677199 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:43.180445 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-aef82bee-1b8b-4acd-94af-24b82b677199 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:43.180919 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-aef82bee-1b8b-4acd-94af-24b82b677199 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:43.327425 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-aef82bee-1b8b-4acd-94af-24b82b677199 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:43.337207 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-aef82bee-1b8b-4acd-94af-24b82b677199 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:43.339045 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-aef82bee-1b8b-4acd-94af-24b82b677199 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:43.340303 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-aef82bee-1b8b-4acd-94af-24b82b677199 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1731 microversion: 2.20 time: 0.173475 Aug 24 03:58:43.340932 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 418/838] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:43 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:58:43.770330 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-981b2b3f-3a2a-42e5-bfef-d8259df744b0 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:43.770962 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-981b2b3f-3a2a-42e5-bfef-d8259df744b0 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 6052f56c-fecc-42d7-a99a-e192c776be59] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:43.777127 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-981b2b3f-3a2a-42e5-bfef-d8259df744b0 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:43.777614 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-981b2b3f-3a2a-42e5-bfef-d8259df744b0 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:43.778047 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-981b2b3f-3a2a-42e5-bfef-d8259df744b0 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:43.778768 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-981b2b3f-3a2a-42e5-bfef-d8259df744b0 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:43.779220 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-981b2b3f-3a2a-42e5-bfef-d8259df744b0 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:43.779641 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-981b2b3f-3a2a-42e5-bfef-d8259df744b0 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:43.852538 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-981b2b3f-3a2a-42e5-bfef-d8259df744b0 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206cb5005354ab4a716efb525c633e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3d57c8abbd49e69c0caad57f7f9815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:43.862363 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-981b2b3f-3a2a-42e5-bfef-d8259df744b0 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59" status: 200 len: 1222 microversion: 2.1 time: 0.096015 Aug 24 03:58:43.863302 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 419/839] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:43 2022] GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59 => generated 1222 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:58:44.367998 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-7b1b2693-2d70-458a-8b57-8ce47389cbdd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:44.368719 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-7b1b2693-2d70-458a-8b57-8ce47389cbdd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:44.375406 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7b1b2693-2d70-458a-8b57-8ce47389cbdd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:44.375890 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7b1b2693-2d70-458a-8b57-8ce47389cbdd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:44.376329 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7b1b2693-2d70-458a-8b57-8ce47389cbdd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:44.377031 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7b1b2693-2d70-458a-8b57-8ce47389cbdd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:44.378088 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7b1b2693-2d70-458a-8b57-8ce47389cbdd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:44.378742 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7b1b2693-2d70-458a-8b57-8ce47389cbdd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:44.519019 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-7b1b2693-2d70-458a-8b57-8ce47389cbdd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:44.527058 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-7b1b2693-2d70-458a-8b57-8ce47389cbdd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:44.528535 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-7b1b2693-2d70-458a-8b57-8ce47389cbdd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:44.529670 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-7b1b2693-2d70-458a-8b57-8ce47389cbdd tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1731 microversion: 2.20 time: 0.165573 Aug 24 03:58:44.530219 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 420/840] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:44 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:58:44.882818 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-22ea4dd6-0479-409b-a778-33c2d2e3a936 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:44.883496 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-22ea4dd6-0479-409b-a778-33c2d2e3a936 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 6052f56c-fecc-42d7-a99a-e192c776be59] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:44.889575 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-22ea4dd6-0479-409b-a778-33c2d2e3a936 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:44.890051 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-22ea4dd6-0479-409b-a778-33c2d2e3a936 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:44.890478 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-22ea4dd6-0479-409b-a778-33c2d2e3a936 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:44.891178 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-22ea4dd6-0479-409b-a778-33c2d2e3a936 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:44.891620 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-22ea4dd6-0479-409b-a778-33c2d2e3a936 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:44.892029 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-22ea4dd6-0479-409b-a778-33c2d2e3a936 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:44.953365 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-22ea4dd6-0479-409b-a778-33c2d2e3a936 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206cb5005354ab4a716efb525c633e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3d57c8abbd49e69c0caad57f7f9815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:44.961542 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-22ea4dd6-0479-409b-a778-33c2d2e3a936 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59" status: 200 len: 1222 microversion: 2.1 time: 0.082934 Aug 24 03:58:44.962112 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 421/841] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:44 2022] GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:58:45.554017 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-9a9ea25d-7e45-4cd1-a80e-047599ccedd5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:45.554830 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-9a9ea25d-7e45-4cd1-a80e-047599ccedd5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:45.561151 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9a9ea25d-7e45-4cd1-a80e-047599ccedd5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:45.561676 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9a9ea25d-7e45-4cd1-a80e-047599ccedd5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:45.562143 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9a9ea25d-7e45-4cd1-a80e-047599ccedd5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:45.562869 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9a9ea25d-7e45-4cd1-a80e-047599ccedd5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:45.563315 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9a9ea25d-7e45-4cd1-a80e-047599ccedd5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:45.563733 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9a9ea25d-7e45-4cd1-a80e-047599ccedd5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:45.696019 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-9a9ea25d-7e45-4cd1-a80e-047599ccedd5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:45.704319 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-9a9ea25d-7e45-4cd1-a80e-047599ccedd5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:45.705892 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-9a9ea25d-7e45-4cd1-a80e-047599ccedd5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:45.708026 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-9a9ea25d-7e45-4cd1-a80e-047599ccedd5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1731 microversion: 2.20 time: 0.157650 Aug 24 03:58:45.708026 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 422/842] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:45 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:58:45.982263 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-02327bdd-3a0e-4f66-97b0-cd92047a4082 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:45.983017 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-02327bdd-3a0e-4f66-97b0-cd92047a4082 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 6052f56c-fecc-42d7-a99a-e192c776be59] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:45.989643 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-02327bdd-3a0e-4f66-97b0-cd92047a4082 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:45.990120 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-02327bdd-3a0e-4f66-97b0-cd92047a4082 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:45.990590 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-02327bdd-3a0e-4f66-97b0-cd92047a4082 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:45.991298 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-02327bdd-3a0e-4f66-97b0-cd92047a4082 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:45.991744 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-02327bdd-3a0e-4f66-97b0-cd92047a4082 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:45.992163 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-02327bdd-3a0e-4f66-97b0-cd92047a4082 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:46.056245 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-02327bdd-3a0e-4f66-97b0-cd92047a4082 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206cb5005354ab4a716efb525c633e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3d57c8abbd49e69c0caad57f7f9815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:46.063779 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-02327bdd-3a0e-4f66-97b0-cd92047a4082 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59" status: 200 len: 1214 microversion: 2.1 time: 0.085349 Aug 24 03:58:46.064345 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 423/843] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:45 2022] GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:58:46.097788 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ad465ecd-d570-487a-bf46-2bbcc7985c1a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "POST /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.882258 Aug 24 03:58:46.098424 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 421/844] 10.222.0.82 () {60 vars in 1323 bytes} [Wed Aug 24 03:58:38 2022] POST /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba/os-volume_attachments => generated 194 bytes in 7884 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:46.731092 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-965e0210-4380-44f1-9213-9fca7153c9fe tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:46.731683 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-965e0210-4380-44f1-9213-9fca7153c9fe tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:46.738032 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-965e0210-4380-44f1-9213-9fca7153c9fe tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:46.738675 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-965e0210-4380-44f1-9213-9fca7153c9fe tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:46.738972 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-965e0210-4380-44f1-9213-9fca7153c9fe tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:46.739660 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-965e0210-4380-44f1-9213-9fca7153c9fe tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:46.740108 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-965e0210-4380-44f1-9213-9fca7153c9fe tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:46.740527 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-965e0210-4380-44f1-9213-9fca7153c9fe tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:47.086641 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e577a734-dbbf-4764-bf5c-cf25f8cdd6e9 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:47.093894 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e577a734-dbbf-4764-bf5c-cf25f8cdd6e9 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 6052f56c-fecc-42d7-a99a-e192c776be59] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:47.093894 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:47.094362 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e577a734-dbbf-4764-bf5c-cf25f8cdd6e9 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:47.094888 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e577a734-dbbf-4764-bf5c-cf25f8cdd6e9 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:47.095325 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e577a734-dbbf-4764-bf5c-cf25f8cdd6e9 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:47.096030 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e577a734-dbbf-4764-bf5c-cf25f8cdd6e9 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:47.096530 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e577a734-dbbf-4764-bf5c-cf25f8cdd6e9 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:47.096955 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e577a734-dbbf-4764-bf5c-cf25f8cdd6e9 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:47.111465 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-965e0210-4380-44f1-9213-9fca7153c9fe tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:47.120459 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-965e0210-4380-44f1-9213-9fca7153c9fe tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:47.121964 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-965e0210-4380-44f1-9213-9fca7153c9fe tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:47.123186 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-965e0210-4380-44f1-9213-9fca7153c9fe tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1731 microversion: 2.20 time: 0.396125 Aug 24 03:58:47.123747 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 424/845] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:46 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1731 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:58:47.162391 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-e577a734-dbbf-4764-bf5c-cf25f8cdd6e9 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206cb5005354ab4a716efb525c633e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3d57c8abbd49e69c0caad57f7f9815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:47.170163 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e577a734-dbbf-4764-bf5c-cf25f8cdd6e9 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59" status: 200 len: 1270 microversion: 2.1 time: 0.088690 Aug 24 03:58:47.170754 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 422/846] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:47 2022] GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59 => generated 1270 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:58:48.148413 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-c443ab9f-c37e-4b91-aa5d-af9dbf0ab7e5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:48.149120 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-c443ab9f-c37e-4b91-aa5d-af9dbf0ab7e5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:48.155604 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c443ab9f-c37e-4b91-aa5d-af9dbf0ab7e5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:48.156079 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c443ab9f-c37e-4b91-aa5d-af9dbf0ab7e5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:48.156508 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c443ab9f-c37e-4b91-aa5d-af9dbf0ab7e5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:48.157198 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c443ab9f-c37e-4b91-aa5d-af9dbf0ab7e5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:48.157650 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c443ab9f-c37e-4b91-aa5d-af9dbf0ab7e5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:48.158071 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c443ab9f-c37e-4b91-aa5d-af9dbf0ab7e5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:48.192655 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-baed4c57-3754-4076-b56e-0ca23348ca54 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:48.193393 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-baed4c57-3754-4076-b56e-0ca23348ca54 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 6052f56c-fecc-42d7-a99a-e192c776be59] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:48.199939 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-baed4c57-3754-4076-b56e-0ca23348ca54 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:48.200419 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-baed4c57-3754-4076-b56e-0ca23348ca54 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:48.200852 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-baed4c57-3754-4076-b56e-0ca23348ca54 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:48.201558 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-baed4c57-3754-4076-b56e-0ca23348ca54 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:48.202354 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-baed4c57-3754-4076-b56e-0ca23348ca54 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:48.202746 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-baed4c57-3754-4076-b56e-0ca23348ca54 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:48.309244 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-c443ab9f-c37e-4b91-aa5d-af9dbf0ab7e5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:48.319414 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-c443ab9f-c37e-4b91-aa5d-af9dbf0ab7e5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:48.321202 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-c443ab9f-c37e-4b91-aa5d-af9dbf0ab7e5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:48.322474 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-c443ab9f-c37e-4b91-aa5d-af9dbf0ab7e5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1731 microversion: 2.20 time: 0.178095 Aug 24 03:58:48.323308 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 425/847] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:48 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:48.363428 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-baed4c57-3754-4076-b56e-0ca23348ca54 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206cb5005354ab4a716efb525c633e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3d57c8abbd49e69c0caad57f7f9815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:48.374027 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-baed4c57-3754-4076-b56e-0ca23348ca54 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59" status: 200 len: 1318 microversion: 2.1 time: 0.186145 Aug 24 03:58:48.375597 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 423/848] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:48 2022] GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:58:49.060480 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-281c4c96-4615-4d39-8ec0-3c29d191c4a2 req-05a308b1-0d38-4904-a53c-a514728a300f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6052f56c-fecc-42d7-a99a-e192c776be59", "tag": "9d1a4a2e-e6c4-42f5-a574-515f4e9d090c"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:49.070839 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-281c4c96-4615-4d39-8ec0-3c29d191c4a2 req-05a308b1-0d38-4904-a53c-a514728a300f service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:49.071314 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-281c4c96-4615-4d39-8ec0-3c29d191c4a2 req-05a308b1-0d38-4904-a53c-a514728a300f service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:49.071735 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-281c4c96-4615-4d39-8ec0-3c29d191c4a2 req-05a308b1-0d38-4904-a53c-a514728a300f service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:49.083677 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-281c4c96-4615-4d39-8ec0-3c29d191c4a2 req-05a308b1-0d38-4904-a53c-a514728a300f service nova] Creating event network-changed:9d1a4a2e-e6c4-42f5-a574-515f4e9d090c for instance 6052f56c-fecc-42d7-a99a-e192c776be59 on hv-cinder-85426 Aug 24 03:58:49.088774 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-281c4c96-4615-4d39-8ec0-3c29d191c4a2 req-05a308b1-0d38-4904-a53c-a514728a300f service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044585 Aug 24 03:58:49.089391 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 426/849] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:49.351798 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c8c1262f-8ff0-4ba0-b250-4d144aed8d0e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:49.351798 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c8c1262f-8ff0-4ba0-b250-4d144aed8d0e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:49.355568 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c8c1262f-8ff0-4ba0-b250-4d144aed8d0e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:49.356071 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c8c1262f-8ff0-4ba0-b250-4d144aed8d0e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:49.356535 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c8c1262f-8ff0-4ba0-b250-4d144aed8d0e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:49.357450 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c8c1262f-8ff0-4ba0-b250-4d144aed8d0e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:49.357929 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c8c1262f-8ff0-4ba0-b250-4d144aed8d0e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:49.358464 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c8c1262f-8ff0-4ba0-b250-4d144aed8d0e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:49.401471 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-e4229019-90e7-4f9d-b7f2-cf288b11ee99 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:49.402488 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-e4229019-90e7-4f9d-b7f2-cf288b11ee99 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 6052f56c-fecc-42d7-a99a-e192c776be59] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:49.410768 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e4229019-90e7-4f9d-b7f2-cf288b11ee99 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:49.411788 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e4229019-90e7-4f9d-b7f2-cf288b11ee99 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:49.412429 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e4229019-90e7-4f9d-b7f2-cf288b11ee99 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:49.413446 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e4229019-90e7-4f9d-b7f2-cf288b11ee99 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:49.414002 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e4229019-90e7-4f9d-b7f2-cf288b11ee99 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:49.414753 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e4229019-90e7-4f9d-b7f2-cf288b11ee99 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:49.437643 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell1:SELECT=100 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:49.520149 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-c8c1262f-8ff0-4ba0-b250-4d144aed8d0e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:49.528951 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-c8c1262f-8ff0-4ba0-b250-4d144aed8d0e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:49.530443 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-c8c1262f-8ff0-4ba0-b250-4d144aed8d0e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:49.531664 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c8c1262f-8ff0-4ba0-b250-4d144aed8d0e tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1731 microversion: 2.20 time: 0.190339 Aug 24 03:58:49.532222 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 424/850] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:49 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1731 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:49.566796 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-e4229019-90e7-4f9d-b7f2-cf288b11ee99 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206cb5005354ab4a716efb525c633e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3d57c8abbd49e69c0caad57f7f9815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:49.577175 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-e4229019-90e7-4f9d-b7f2-cf288b11ee99 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59" status: 200 len: 1318 microversion: 2.1 time: 0.179633 Aug 24 03:58:49.577175 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 427/851] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:49 2022] GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:58:49.793423 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-45137e1c-2c69-42ba-80a8-a7fd1ad259f0 req-8bf67424-29f2-41ba-aeef-870cffc11feb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df85e6fe-54b4-456b-875d-7c3b6418c40e", "name": "network-vif-plugged", "status": "completed", "tag": "b70bff9a-be9c-4b03-8c48-2151d8730e62"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:49.804006 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-45137e1c-2c69-42ba-80a8-a7fd1ad259f0 req-8bf67424-29f2-41ba-aeef-870cffc11feb service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:49.804493 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-45137e1c-2c69-42ba-80a8-a7fd1ad259f0 req-8bf67424-29f2-41ba-aeef-870cffc11feb service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:49.804922 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-45137e1c-2c69-42ba-80a8-a7fd1ad259f0 req-8bf67424-29f2-41ba-aeef-870cffc11feb service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:49.816619 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-45137e1c-2c69-42ba-80a8-a7fd1ad259f0 req-8bf67424-29f2-41ba-aeef-870cffc11feb service nova] Creating event network-vif-plugged:b70bff9a-be9c-4b03-8c48-2151d8730e62 for instance df85e6fe-54b4-456b-875d-7c3b6418c40e on hv-cinder-85426 Aug 24 03:58:49.821640 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-45137e1c-2c69-42ba-80a8-a7fd1ad259f0 req-8bf67424-29f2-41ba-aeef-870cffc11feb service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031836 Aug 24 03:58:49.822226 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 425/852] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:50.556407 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-928cb6c3-0e5a-43ca-875c-f5bcf29ff7c8 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:50.557049 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-928cb6c3-0e5a-43ca-875c-f5bcf29ff7c8 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:50.558907 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell0:SELECT=2 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:50.564205 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-928cb6c3-0e5a-43ca-875c-f5bcf29ff7c8 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:50.564788 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-928cb6c3-0e5a-43ca-875c-f5bcf29ff7c8 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:50.565229 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-928cb6c3-0e5a-43ca-875c-f5bcf29ff7c8 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:50.565919 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-928cb6c3-0e5a-43ca-875c-f5bcf29ff7c8 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:50.566368 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-928cb6c3-0e5a-43ca-875c-f5bcf29ff7c8 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:50.566814 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-928cb6c3-0e5a-43ca-875c-f5bcf29ff7c8 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:50.602236 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-62c3af5a-9fb7-4260-ac99-02de81b94e2b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:50.603425 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-62c3af5a-9fb7-4260-ac99-02de81b94e2b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 6052f56c-fecc-42d7-a99a-e192c776be59] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:50.610252 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62c3af5a-9fb7-4260-ac99-02de81b94e2b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:50.610780 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62c3af5a-9fb7-4260-ac99-02de81b94e2b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:50.611479 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62c3af5a-9fb7-4260-ac99-02de81b94e2b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:50.612940 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62c3af5a-9fb7-4260-ac99-02de81b94e2b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:50.613483 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62c3af5a-9fb7-4260-ac99-02de81b94e2b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:50.613937 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62c3af5a-9fb7-4260-ac99-02de81b94e2b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:50.702223 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-928cb6c3-0e5a-43ca-875c-f5bcf29ff7c8 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:50.711732 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-928cb6c3-0e5a-43ca-875c-f5bcf29ff7c8 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:50.713560 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-928cb6c3-0e5a-43ca-875c-f5bcf29ff7c8 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:50.714736 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-928cb6c3-0e5a-43ca-875c-f5bcf29ff7c8 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1731 microversion: 2.20 time: 0.162675 Aug 24 03:58:50.715299 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 428/853] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:50 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:50.750066 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-62c3af5a-9fb7-4260-ac99-02de81b94e2b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206cb5005354ab4a716efb525c633e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3d57c8abbd49e69c0caad57f7f9815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:50.758649 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-62c3af5a-9fb7-4260-ac99-02de81b94e2b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59" status: 200 len: 1318 microversion: 2.1 time: 0.161667 Aug 24 03:58:50.759224 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 426/854] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:50 2022] GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:58:51.739761 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-b022d4c8-a470-4871-bbdf-5444340660fb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:51.740411 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-b022d4c8-a470-4871-bbdf-5444340660fb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:51.742630 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell0:SELECT=10 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:51.747557 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b022d4c8-a470-4871-bbdf-5444340660fb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:51.748063 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b022d4c8-a470-4871-bbdf-5444340660fb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:51.748497 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b022d4c8-a470-4871-bbdf-5444340660fb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:51.749183 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b022d4c8-a470-4871-bbdf-5444340660fb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:51.749638 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b022d4c8-a470-4871-bbdf-5444340660fb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:51.750056 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b022d4c8-a470-4871-bbdf-5444340660fb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:51.779080 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5c75a3af-a94e-4bdd-9408-6f401350296f tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:51.779676 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5c75a3af-a94e-4bdd-9408-6f401350296f tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 6052f56c-fecc-42d7-a99a-e192c776be59] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:51.786867 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5c75a3af-a94e-4bdd-9408-6f401350296f tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:51.787568 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5c75a3af-a94e-4bdd-9408-6f401350296f tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:51.787789 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5c75a3af-a94e-4bdd-9408-6f401350296f tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:51.788489 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5c75a3af-a94e-4bdd-9408-6f401350296f tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:51.788947 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5c75a3af-a94e-4bdd-9408-6f401350296f tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:51.789370 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5c75a3af-a94e-4bdd-9408-6f401350296f tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:51.882521 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-b022d4c8-a470-4871-bbdf-5444340660fb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:51.890877 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-b022d4c8-a470-4871-bbdf-5444340660fb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:51.893274 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-b022d4c8-a470-4871-bbdf-5444340660fb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:51.894585 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-b022d4c8-a470-4871-bbdf-5444340660fb tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1731 microversion: 2.20 time: 0.159913 Aug 24 03:58:51.895363 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 429/855] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:51 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:51.920598 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-5c75a3af-a94e-4bdd-9408-6f401350296f tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206cb5005354ab4a716efb525c633e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3d57c8abbd49e69c0caad57f7f9815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:51.929402 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5c75a3af-a94e-4bdd-9408-6f401350296f tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59" status: 200 len: 1318 microversion: 2.1 time: 0.154118 Aug 24 03:58:51.929971 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 427/856] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:51 2022] GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:58:52.918094 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-5c7e7252-9ec2-46d8-8957-c787ba5b49b1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:52.918806 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-5c7e7252-9ec2-46d8-8957-c787ba5b49b1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:52.925566 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5c7e7252-9ec2-46d8-8957-c787ba5b49b1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:52.926044 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5c7e7252-9ec2-46d8-8957-c787ba5b49b1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:52.926477 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5c7e7252-9ec2-46d8-8957-c787ba5b49b1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:52.927211 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5c7e7252-9ec2-46d8-8957-c787ba5b49b1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:52.927655 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5c7e7252-9ec2-46d8-8957-c787ba5b49b1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:52.928072 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5c7e7252-9ec2-46d8-8957-c787ba5b49b1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:52.949274 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-122c61e4-8374-4cd4-949c-95a8e6502abc tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:52.949891 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-122c61e4-8374-4cd4-949c-95a8e6502abc tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 6052f56c-fecc-42d7-a99a-e192c776be59] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:52.956930 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-122c61e4-8374-4cd4-949c-95a8e6502abc tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:52.957414 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-122c61e4-8374-4cd4-949c-95a8e6502abc tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:52.957852 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-122c61e4-8374-4cd4-949c-95a8e6502abc tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:52.958687 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-122c61e4-8374-4cd4-949c-95a8e6502abc tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:52.959021 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-122c61e4-8374-4cd4-949c-95a8e6502abc tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:52.959451 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-122c61e4-8374-4cd4-949c-95a8e6502abc tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:53.070474 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-5c7e7252-9ec2-46d8-8957-c787ba5b49b1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:53.078418 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-5c7e7252-9ec2-46d8-8957-c787ba5b49b1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:53.080673 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-5c7e7252-9ec2-46d8-8957-c787ba5b49b1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:53.082370 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-5c7e7252-9ec2-46d8-8957-c787ba5b49b1 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1731 microversion: 2.20 time: 0.168376 Aug 24 03:58:53.082970 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 430/857] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:52 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:53.104750 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-122c61e4-8374-4cd4-949c-95a8e6502abc tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206cb5005354ab4a716efb525c633e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3d57c8abbd49e69c0caad57f7f9815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:53.111017 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-122c61e4-8374-4cd4-949c-95a8e6502abc tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59" status: 200 len: 1318 microversion: 2.1 time: 0.165560 Aug 24 03:58:53.111645 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 428/858] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:52 2022] GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:58:54.105440 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-7f94987b-8fe2-454b-8e4c-23c2cecb5425 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:54.106024 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-7f94987b-8fe2-454b-8e4c-23c2cecb5425 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:54.113414 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7f94987b-8fe2-454b-8e4c-23c2cecb5425 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:54.113897 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7f94987b-8fe2-454b-8e4c-23c2cecb5425 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:54.114325 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7f94987b-8fe2-454b-8e4c-23c2cecb5425 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:54.115080 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7f94987b-8fe2-454b-8e4c-23c2cecb5425 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:54.115527 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7f94987b-8fe2-454b-8e4c-23c2cecb5425 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:54.116000 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7f94987b-8fe2-454b-8e4c-23c2cecb5425 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:54.131745 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2b9e206c-784a-45cd-a8cd-d81085f5daf9 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:54.132910 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2b9e206c-784a-45cd-a8cd-d81085f5daf9 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 6052f56c-fecc-42d7-a99a-e192c776be59] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:54.139723 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2b9e206c-784a-45cd-a8cd-d81085f5daf9 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:54.140201 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2b9e206c-784a-45cd-a8cd-d81085f5daf9 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:54.140632 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2b9e206c-784a-45cd-a8cd-d81085f5daf9 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:54.141323 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2b9e206c-784a-45cd-a8cd-d81085f5daf9 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:54.141801 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2b9e206c-784a-45cd-a8cd-d81085f5daf9 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:54.142268 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2b9e206c-784a-45cd-a8cd-d81085f5daf9 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:54.247201 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-7f94987b-8fe2-454b-8e4c-23c2cecb5425 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:54.255732 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-7f94987b-8fe2-454b-8e4c-23c2cecb5425 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:54.257218 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-7f94987b-8fe2-454b-8e4c-23c2cecb5425 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:54.258362 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-7f94987b-8fe2-454b-8e4c-23c2cecb5425 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1731 microversion: 2.20 time: 0.157106 Aug 24 03:58:54.258957 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 431/859] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:54 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:54.280223 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-2b9e206c-784a-45cd-a8cd-d81085f5daf9 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206cb5005354ab4a716efb525c633e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3d57c8abbd49e69c0caad57f7f9815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:54.288798 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2b9e206c-784a-45cd-a8cd-d81085f5daf9 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59" status: 200 len: 1318 microversion: 2.1 time: 0.161268 Aug 24 03:58:54.289483 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 429/860] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:54 2022] GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:58:55.152272 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-f7235f31-83cd-457c-a48f-3a91df38bbae tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:55.152856 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-f7235f31-83cd-457c-a48f-3a91df38bbae tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 66dd80a8-8e33-421c-9c4a-200ad720823a] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:55.159483 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f7235f31-83cd-457c-a48f-3a91df38bbae tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:55.159955 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f7235f31-83cd-457c-a48f-3a91df38bbae tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:55.160380 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f7235f31-83cd-457c-a48f-3a91df38bbae tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:55.161052 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f7235f31-83cd-457c-a48f-3a91df38bbae tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:55.161493 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f7235f31-83cd-457c-a48f-3a91df38bbae tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:55.161906 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f7235f31-83cd-457c-a48f-3a91df38bbae tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:55.185097 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-f7235f31-83cd-457c-a48f-3a91df38bbae tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a/ips" status: 200 len: 151 microversion: 2.1 time: 0.036693 Aug 24 03:58:55.185661 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 432/861] 10.222.0.82 () {58 vars in 1248 bytes} [Wed Aug 24 03:58:55 2022] GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:55.281364 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ba3f3681-3224-49b4-8e42-9bd44bd3cc8c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:55.281873 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ba3f3681-3224-49b4-8e42-9bd44bd3cc8c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:55.289020 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba3f3681-3224-49b4-8e42-9bd44bd3cc8c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:55.289507 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba3f3681-3224-49b4-8e42-9bd44bd3cc8c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:55.291843 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba3f3681-3224-49b4-8e42-9bd44bd3cc8c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:55.291843 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba3f3681-3224-49b4-8e42-9bd44bd3cc8c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:55.291843 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba3f3681-3224-49b4-8e42-9bd44bd3cc8c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:55.291843 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba3f3681-3224-49b4-8e42-9bd44bd3cc8c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:55.311375 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-299dc4c2-d703-49f0-9e25-0945a3d92f1c tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:55.312162 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-299dc4c2-d703-49f0-9e25-0945a3d92f1c tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 6052f56c-fecc-42d7-a99a-e192c776be59] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:55.318532 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-299dc4c2-d703-49f0-9e25-0945a3d92f1c tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:55.319531 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-299dc4c2-d703-49f0-9e25-0945a3d92f1c tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:55.319741 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-299dc4c2-d703-49f0-9e25-0945a3d92f1c tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:55.320500 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-299dc4c2-d703-49f0-9e25-0945a3d92f1c tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:55.321024 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-299dc4c2-d703-49f0-9e25-0945a3d92f1c tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:55.321516 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-299dc4c2-d703-49f0-9e25-0945a3d92f1c tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:55.429298 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-ba3f3681-3224-49b4-8e42-9bd44bd3cc8c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:55.437660 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-ba3f3681-3224-49b4-8e42-9bd44bd3cc8c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:55.439952 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-ba3f3681-3224-49b4-8e42-9bd44bd3cc8c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:55.441154 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ba3f3681-3224-49b4-8e42-9bd44bd3cc8c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1718 microversion: 2.20 time: 0.163873 Aug 24 03:58:55.442075 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 430/862] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:55 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1718 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:55.463826 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-299dc4c2-d703-49f0-9e25-0945a3d92f1c tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206cb5005354ab4a716efb525c633e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3d57c8abbd49e69c0caad57f7f9815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:55.471458 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-299dc4c2-d703-49f0-9e25-0945a3d92f1c tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59" status: 200 len: 1318 microversion: 2.1 time: 0.164751 Aug 24 03:58:55.472024 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 433/863] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:55 2022] GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:58:55.796941 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-df1011ec-4e9d-42a7-a02a-a2315aca3a5c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:55.800271 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-df1011ec-4e9d-42a7-a02a-a2315aca3a5c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: a362c623-fa9a-4da0-b8f5-64233f2651ba] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:55.806561 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-df1011ec-4e9d-42a7-a02a-a2315aca3a5c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:55.807034 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-df1011ec-4e9d-42a7-a02a-a2315aca3a5c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:55.807471 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-df1011ec-4e9d-42a7-a02a-a2315aca3a5c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:55.808282 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-df1011ec-4e9d-42a7-a02a-a2315aca3a5c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:55.808735 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-df1011ec-4e9d-42a7-a02a-a2315aca3a5c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:55.809426 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-df1011ec-4e9d-42a7-a02a-a2315aca3a5c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:55.842616 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-df1011ec-4e9d-42a7-a02a-a2315aca3a5c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049586 Aug 24 03:58:55.843515 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 431/864] 10.222.0.82 () {58 vars in 1302 bytes} [Wed Aug 24 03:58:55 2022] GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:58:55.897623 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-eede2ccc-c212-497a-926e-976a42837599 req-b6320a55-950f-4015-887b-dd843e842e38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6052f56c-fecc-42d7-a99a-e192c776be59", "name": "network-vif-plugged", "status": "completed", "tag": "9d1a4a2e-e6c4-42f5-a574-515f4e9d090c"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:55.907021 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-eede2ccc-c212-497a-926e-976a42837599 req-b6320a55-950f-4015-887b-dd843e842e38 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:55.912167 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-eede2ccc-c212-497a-926e-976a42837599 req-b6320a55-950f-4015-887b-dd843e842e38 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:55.912167 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-eede2ccc-c212-497a-926e-976a42837599 req-b6320a55-950f-4015-887b-dd843e842e38 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:55.918717 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-eede2ccc-c212-497a-926e-976a42837599 req-b6320a55-950f-4015-887b-dd843e842e38 service nova] Creating event network-vif-plugged:9d1a4a2e-e6c4-42f5-a574-515f4e9d090c for instance 6052f56c-fecc-42d7-a99a-e192c776be59 on hv-cinder-85426 Aug 24 03:58:55.923391 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-eede2ccc-c212-497a-926e-976a42837599 req-b6320a55-950f-4015-887b-dd843e842e38 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029485 Aug 24 03:58:55.924546 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 434/865] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:55.985103 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9c0717cd-e196-486e-b6f7-b38608bf8cef tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:55.985747 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9c0717cd-e196-486e-b6f7-b38608bf8cef tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: a362c623-fa9a-4da0-b8f5-64233f2651ba] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:55.993585 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c0717cd-e196-486e-b6f7-b38608bf8cef tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:55.994081 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c0717cd-e196-486e-b6f7-b38608bf8cef tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:55.994548 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c0717cd-e196-486e-b6f7-b38608bf8cef tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:55.995297 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c0717cd-e196-486e-b6f7-b38608bf8cef tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:55.995700 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c0717cd-e196-486e-b6f7-b38608bf8cef tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:55.996126 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9c0717cd-e196-486e-b6f7-b38608bf8cef tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:56.029877 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9c0717cd-e196-486e-b6f7-b38608bf8cef tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba/os-volume_attachments/3ebc223d-cc59-4e75-8834-b0c1c6530ab7" status: 200 len: 194 microversion: 2.1 time: 0.048745 Aug 24 03:58:56.034550 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 432/866] 10.222.0.82 () {58 vars in 1413 bytes} [Wed Aug 24 03:58:55 2022] GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba/os-volume_attachments/3ebc223d-cc59-4e75-8834-b0c1c6530ab7 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:56.041725 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-0549f1ed-360f-416b-8fff-08b2e91f8ee1 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:56.044024 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-0549f1ed-360f-416b-8fff-08b2e91f8ee1 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: a362c623-fa9a-4da0-b8f5-64233f2651ba] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:56.048470 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0549f1ed-360f-416b-8fff-08b2e91f8ee1 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:56.049486 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0549f1ed-360f-416b-8fff-08b2e91f8ee1 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:56.049923 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0549f1ed-360f-416b-8fff-08b2e91f8ee1 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:56.050645 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0549f1ed-360f-416b-8fff-08b2e91f8ee1 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:56.051103 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0549f1ed-360f-416b-8fff-08b2e91f8ee1 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:56.051526 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0549f1ed-360f-416b-8fff-08b2e91f8ee1 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:56.135991 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.objects.instance [None req-0549f1ed-360f-416b-8fff-08b2e91f8ee1 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lazy-loading 'services' on Instance uuid a362c623-fa9a-4da0-b8f5-64233f2651ba {{(pid=127869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:58:56.342947 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-0549f1ed-360f-416b-8fff-08b2e91f8ee1 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "DELETE /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba/os-volume_attachments/3ebc223d-cc59-4e75-8834-b0c1c6530ab7" status: 202 len: 0 microversion: 2.1 time: 0.305339 Aug 24 03:58:56.344845 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 435/867] 10.222.0.82 () {58 vars in 1416 bytes} [Wed Aug 24 03:58:56 2022] DELETE /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba/os-volume_attachments/3ebc223d-cc59-4e75-8834-b0c1c6530ab7 => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:58:56.493326 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e7eaf004-1ed5-4175-8da2-57b1467e0eaa tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:56.493948 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e7eaf004-1ed5-4175-8da2-57b1467e0eaa tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 6052f56c-fecc-42d7-a99a-e192c776be59] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:56.500489 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7eaf004-1ed5-4175-8da2-57b1467e0eaa tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:56.500975 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7eaf004-1ed5-4175-8da2-57b1467e0eaa tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:56.501415 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7eaf004-1ed5-4175-8da2-57b1467e0eaa tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:56.502196 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7eaf004-1ed5-4175-8da2-57b1467e0eaa tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:56.502685 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7eaf004-1ed5-4175-8da2-57b1467e0eaa tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:56.503115 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7eaf004-1ed5-4175-8da2-57b1467e0eaa tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:56.640918 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-e7eaf004-1ed5-4175-8da2-57b1467e0eaa tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206cb5005354ab4a716efb525c633e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3d57c8abbd49e69c0caad57f7f9815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:56.648954 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e7eaf004-1ed5-4175-8da2-57b1467e0eaa tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59" status: 200 len: 1318 microversion: 2.1 time: 0.159619 Aug 24 03:58:56.649518 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 433/868] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:56 2022] GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:56.832246 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-bce9114a-44b4-4870-a095-ba1b247a58b3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32a4410a-a3dd-49b4-a676-2bd7b18d0c94"}} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:56.834851 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-bce9114a-44b4-4870-a095-ba1b247a58b3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 66dd80a8-8e33-421c-9c4a-200ad720823a] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:56.841048 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bce9114a-44b4-4870-a095-ba1b247a58b3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:56.841525 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bce9114a-44b4-4870-a095-ba1b247a58b3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:56.841958 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bce9114a-44b4-4870-a095-ba1b247a58b3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:56.842674 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bce9114a-44b4-4870-a095-ba1b247a58b3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:56.843122 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bce9114a-44b4-4870-a095-ba1b247a58b3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:56.843535 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bce9114a-44b4-4870-a095-ba1b247a58b3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:57.670684 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c7cbe599-58ea-436e-9618-cb21904ed8ce tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:57.671230 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c7cbe599-58ea-436e-9618-cb21904ed8ce tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 6052f56c-fecc-42d7-a99a-e192c776be59] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:57.678378 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c7cbe599-58ea-436e-9618-cb21904ed8ce tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:57.678903 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c7cbe599-58ea-436e-9618-cb21904ed8ce tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:57.679342 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c7cbe599-58ea-436e-9618-cb21904ed8ce tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:57.680041 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c7cbe599-58ea-436e-9618-cb21904ed8ce tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:57.680498 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c7cbe599-58ea-436e-9618-cb21904ed8ce tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:57.680926 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c7cbe599-58ea-436e-9618-cb21904ed8ce tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:57.813549 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-c7cbe599-58ea-436e-9618-cb21904ed8ce tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206cb5005354ab4a716efb525c633e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3d57c8abbd49e69c0caad57f7f9815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:57.817089 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:57.821770 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c7cbe599-58ea-436e-9618-cb21904ed8ce tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59" status: 200 len: 1318 microversion: 2.1 time: 0.155160 Aug 24 03:58:57.822343 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 434/869] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:57 2022] GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:58:58.176865 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-bce9114a-44b4-4870-a095-ba1b247a58b3 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "POST /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.349905 Aug 24 03:58:58.178142 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 436/870] 10.222.0.82 () {60 vars in 1323 bytes} [Wed Aug 24 03:58:56 2022] POST /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a/os-volume_attachments => generated 194 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:58.842571 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4fc468a9-6578-4291-9882-ebc525120ee5 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:58.843174 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4fc468a9-6578-4291-9882-ebc525120ee5 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 6052f56c-fecc-42d7-a99a-e192c776be59] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:58.850896 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4fc468a9-6578-4291-9882-ebc525120ee5 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:58.851374 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4fc468a9-6578-4291-9882-ebc525120ee5 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:58.851799 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4fc468a9-6578-4291-9882-ebc525120ee5 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:58.852477 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4fc468a9-6578-4291-9882-ebc525120ee5 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:58.852921 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4fc468a9-6578-4291-9882-ebc525120ee5 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:58.853336 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4fc468a9-6578-4291-9882-ebc525120ee5 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:58.989399 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-4fc468a9-6578-4291-9882-ebc525120ee5 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206cb5005354ab4a716efb525c633e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3d57c8abbd49e69c0caad57f7f9815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:58.997194 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4fc468a9-6578-4291-9882-ebc525120ee5 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59" status: 200 len: 1505 microversion: 2.1 time: 0.158782 Aug 24 03:58:58.997768 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 435/871] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:58 2022] GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59 => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:59.855817 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-64d2b706-709d-4fa9-b6b0-362a75e7ec5c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:59.856393 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-64d2b706-709d-4fa9-b6b0-362a75e7ec5c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: a362c623-fa9a-4da0-b8f5-64233f2651ba] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:59.863908 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-64d2b706-709d-4fa9-b6b0-362a75e7ec5c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:59.864238 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-64d2b706-709d-4fa9-b6b0-362a75e7ec5c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:59.865872 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-64d2b706-709d-4fa9-b6b0-362a75e7ec5c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:59.865872 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-64d2b706-709d-4fa9-b6b0-362a75e7ec5c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:59.865872 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-64d2b706-709d-4fa9-b6b0-362a75e7ec5c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:59.867431 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-64d2b706-709d-4fa9-b6b0-362a75e7ec5c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:59.898813 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-64d2b706-709d-4fa9-b6b0-362a75e7ec5c tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba/os-volume_attachments/c29dd358-aca7-49b3-93fc-623bb2738670" status: 200 len: 194 microversion: 2.1 time: 0.047593 Aug 24 03:58:59.900323 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 437/872] 10.222.0.82 () {58 vars in 1413 bytes} [Wed Aug 24 03:58:59 2022] GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba/os-volume_attachments/c29dd358-aca7-49b3-93fc-623bb2738670 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:59.910708 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6b562ae5-e81c-4453-a4fc-adc1932aacc5 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:59.911264 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6b562ae5-e81c-4453-a4fc-adc1932aacc5 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: a362c623-fa9a-4da0-b8f5-64233f2651ba] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:59.917628 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6b562ae5-e81c-4453-a4fc-adc1932aacc5 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:59.918135 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6b562ae5-e81c-4453-a4fc-adc1932aacc5 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:59.918606 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6b562ae5-e81c-4453-a4fc-adc1932aacc5 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:59.919304 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6b562ae5-e81c-4453-a4fc-adc1932aacc5 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:59.919761 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6b562ae5-e81c-4453-a4fc-adc1932aacc5 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:59.920188 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6b562ae5-e81c-4453-a4fc-adc1932aacc5 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:00.009258 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-6b562ae5-e81c-4453-a4fc-adc1932aacc5 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lazy-loading 'services' on Instance uuid a362c623-fa9a-4da0-b8f5-64233f2651ba {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:59:00.281226 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6b562ae5-e81c-4453-a4fc-adc1932aacc5 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "DELETE /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba/os-volume_attachments/c29dd358-aca7-49b3-93fc-623bb2738670" status: 202 len: 0 microversion: 2.1 time: 0.374994 Aug 24 03:59:00.282229 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 436/873] 10.222.0.82 () {58 vars in 1416 bytes} [Wed Aug 24 03:58:59 2022] DELETE /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba/os-volume_attachments/c29dd358-aca7-49b3-93fc-623bb2738670 => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:59:07.436881 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-85ab74e1-f73c-468d-bb6e-20882c29bc09 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:07.437438 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-85ab74e1-f73c-468d-bb6e-20882c29bc09 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 66dd80a8-8e33-421c-9c4a-200ad720823a] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:07.440561 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:07.445425 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-85ab74e1-f73c-468d-bb6e-20882c29bc09 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:07.445941 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-85ab74e1-f73c-468d-bb6e-20882c29bc09 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:07.446451 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-85ab74e1-f73c-468d-bb6e-20882c29bc09 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:07.447228 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-85ab74e1-f73c-468d-bb6e-20882c29bc09 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:07.447681 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-85ab74e1-f73c-468d-bb6e-20882c29bc09 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:07.448108 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-85ab74e1-f73c-468d-bb6e-20882c29bc09 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:07.539876 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.objects.instance [None req-85ab74e1-f73c-468d-bb6e-20882c29bc09 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lazy-loading 'services' on Instance uuid 66dd80a8-8e33-421c-9c4a-200ad720823a {{(pid=127869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:59:07.814617 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-85ab74e1-f73c-468d-bb6e-20882c29bc09 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "DELETE /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a/os-volume_attachments/32a4410a-a3dd-49b4-a676-2bd7b18d0c94" status: 202 len: 0 microversion: 2.1 time: 0.383373 Aug 24 03:59:07.815646 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 438/874] 10.222.0.82 () {58 vars in 1416 bytes} [Wed Aug 24 03:59:07 2022] DELETE /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a/os-volume_attachments/32a4410a-a3dd-49b4-a676-2bd7b18d0c94 => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:59:07.826080 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-09260708-1a83-45da-bde4-d741401bfdea tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:07.832070 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-09260708-1a83-45da-bde4-d741401bfdea tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 66dd80a8-8e33-421c-9c4a-200ad720823a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:07.841222 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09260708-1a83-45da-bde4-d741401bfdea tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:07.842142 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09260708-1a83-45da-bde4-d741401bfdea tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:07.842830 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09260708-1a83-45da-bde4-d741401bfdea tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:07.843712 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09260708-1a83-45da-bde4-d741401bfdea tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:07.844174 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09260708-1a83-45da-bde4-d741401bfdea tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:07.844598 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-09260708-1a83-45da-bde4-d741401bfdea tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:07.862972 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-e1b36335-d7d2-4328-8a22-a3c0cbcd78e4 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:07.865593 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-e1b36335-d7d2-4328-8a22-a3c0cbcd78e4 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: a362c623-fa9a-4da0-b8f5-64233f2651ba] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:07.873007 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e1b36335-d7d2-4328-8a22-a3c0cbcd78e4 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:07.873545 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e1b36335-d7d2-4328-8a22-a3c0cbcd78e4 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:07.874025 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e1b36335-d7d2-4328-8a22-a3c0cbcd78e4 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:07.875045 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e1b36335-d7d2-4328-8a22-a3c0cbcd78e4 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:07.875637 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e1b36335-d7d2-4328-8a22-a3c0cbcd78e4 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:07.876092 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e1b36335-d7d2-4328-8a22-a3c0cbcd78e4 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:07.879772 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-09260708-1a83-45da-bde4-d741401bfdea tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058980 Aug 24 03:59:07.880387 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 437/875] 10.222.0.82 () {58 vars in 1302 bytes} [Wed Aug 24 03:59:07 2022] GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:59:07.915409 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-e1b36335-d7d2-4328-8a22-a3c0cbcd78e4 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057313 Aug 24 03:59:07.916107 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 439/876] 10.222.0.82 () {58 vars in 1302 bytes} [Wed Aug 24 03:59:07 2022] GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 03:59:08.134718 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d47f48cd-1dda-47dd-8c21-a92e8530c014 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:08.137092 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d47f48cd-1dda-47dd-8c21-a92e8530c014 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: a362c623-fa9a-4da0-b8f5-64233f2651ba] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:08.145897 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d47f48cd-1dda-47dd-8c21-a92e8530c014 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:08.146475 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d47f48cd-1dda-47dd-8c21-a92e8530c014 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:08.146995 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d47f48cd-1dda-47dd-8c21-a92e8530c014 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:08.147860 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d47f48cd-1dda-47dd-8c21-a92e8530c014 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:08.148372 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d47f48cd-1dda-47dd-8c21-a92e8530c014 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:08.148834 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d47f48cd-1dda-47dd-8c21-a92e8530c014 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:08.191717 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d47f48cd-1dda-47dd-8c21-a92e8530c014 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060937 Aug 24 03:59:08.193722 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 438/877] 10.222.0.82 () {58 vars in 1302 bytes} [Wed Aug 24 03:59:08 2022] GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:59:08.278419 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-46f6ff9f-32be-4861-b2a9-d602351776de tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:08.280271 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-46f6ff9f-32be-4861-b2a9-d602351776de tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: a362c623-fa9a-4da0-b8f5-64233f2651ba] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:08.293217 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-46f6ff9f-32be-4861-b2a9-d602351776de tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:08.294140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-46f6ff9f-32be-4861-b2a9-d602351776de tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:08.295053 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-46f6ff9f-32be-4861-b2a9-d602351776de tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:08.296819 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-46f6ff9f-32be-4861-b2a9-d602351776de tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:08.297605 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-46f6ff9f-32be-4861-b2a9-d602351776de tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:08.298567 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-46f6ff9f-32be-4861-b2a9-d602351776de tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:08.339613 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-46f6ff9f-32be-4861-b2a9-d602351776de tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: a362c623-fa9a-4da0-b8f5-64233f2651ba] Going to try to terminate instance {{(pid=127869) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:59:08.527880 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:08.778044 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-46f6ff9f-32be-4861-b2a9-d602351776de tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "DELETE /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba" status: 204 len: 0 microversion: 2.1 time: 0.504662 Aug 24 03:59:08.778724 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 440/878] 10.222.0.82 () {58 vars in 1239 bytes} [Wed Aug 24 03:59:08 2022] DELETE /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:59:08.788689 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-73984e07-c20b-45d8-8aa2-fa22fab57dff tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:08.790483 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-73984e07-c20b-45d8-8aa2-fa22fab57dff tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: a362c623-fa9a-4da0-b8f5-64233f2651ba] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:08.797122 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73984e07-c20b-45d8-8aa2-fa22fab57dff tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:08.797706 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73984e07-c20b-45d8-8aa2-fa22fab57dff tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:08.798140 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73984e07-c20b-45d8-8aa2-fa22fab57dff tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:08.798946 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73984e07-c20b-45d8-8aa2-fa22fab57dff tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:08.799621 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73984e07-c20b-45d8-8aa2-fa22fab57dff tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:08.800200 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-73984e07-c20b-45d8-8aa2-fa22fab57dff tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:08.894543 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-564b0907-615f-45f3-9102-4a9138b77b91 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:08.896890 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-564b0907-615f-45f3-9102-4a9138b77b91 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 66dd80a8-8e33-421c-9c4a-200ad720823a] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:08.904662 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-564b0907-615f-45f3-9102-4a9138b77b91 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:08.905148 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-564b0907-615f-45f3-9102-4a9138b77b91 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:08.905583 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-564b0907-615f-45f3-9102-4a9138b77b91 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:08.906291 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-564b0907-615f-45f3-9102-4a9138b77b91 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:08.906920 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-564b0907-615f-45f3-9102-4a9138b77b91 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:08.907184 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-564b0907-615f-45f3-9102-4a9138b77b91 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:08.943918 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-564b0907-615f-45f3-9102-4a9138b77b91 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054185 Aug 24 03:59:08.944501 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 441/879] 10.222.0.82 () {58 vars in 1302 bytes} [Wed Aug 24 03:59:08 2022] GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:59:08.950314 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-73984e07-c20b-45d8-8aa2-fa22fab57dff tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:08.959408 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-73984e07-c20b-45d8-8aa2-fa22fab57dff tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba" status: 200 len: 1673 microversion: 2.1 time: 0.176238 Aug 24 03:59:08.959972 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 439/880] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:08 2022] GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba => generated 1673 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:09.956159 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-c4b841c0-89d6-4852-884e-221819d230ad tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:09.958291 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-c4b841c0-89d6-4852-884e-221819d230ad tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 66dd80a8-8e33-421c-9c4a-200ad720823a] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:09.964659 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c4b841c0-89d6-4852-884e-221819d230ad tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:09.965142 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c4b841c0-89d6-4852-884e-221819d230ad tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:09.965570 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c4b841c0-89d6-4852-884e-221819d230ad tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:09.966252 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c4b841c0-89d6-4852-884e-221819d230ad tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:09.966735 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c4b841c0-89d6-4852-884e-221819d230ad tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:09.967158 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c4b841c0-89d6-4852-884e-221819d230ad tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:09.982125 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-40d412cc-e7e4-466b-8aea-d2bca4de7ecd tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:09.982768 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-40d412cc-e7e4-466b-8aea-d2bca4de7ecd tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: a362c623-fa9a-4da0-b8f5-64233f2651ba] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:09.990435 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-40d412cc-e7e4-466b-8aea-d2bca4de7ecd tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:09.990952 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-40d412cc-e7e4-466b-8aea-d2bca4de7ecd tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:09.991390 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-40d412cc-e7e4-466b-8aea-d2bca4de7ecd tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:09.992093 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-40d412cc-e7e4-466b-8aea-d2bca4de7ecd tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:09.992547 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-40d412cc-e7e4-466b-8aea-d2bca4de7ecd tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:09.993009 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-40d412cc-e7e4-466b-8aea-d2bca4de7ecd tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:09.999894 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-c4b841c0-89d6-4852-884e-221819d230ad tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047477 Aug 24 03:59:10.000991 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 442/881] 10.222.0.82 () {58 vars in 1302 bytes} [Wed Aug 24 03:59:09 2022] GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:59:10.124442 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-40d412cc-e7e4-466b-8aea-d2bca4de7ecd tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:10.133011 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-40d412cc-e7e4-466b-8aea-d2bca4de7ecd tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba" status: 200 len: 1673 microversion: 2.1 time: 0.155186 Aug 24 03:59:10.133575 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 440/882] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:09 2022] GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:11.014968 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-b05bad02-d64a-40d2-8a93-c749d0703ecf tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:11.017106 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-b05bad02-d64a-40d2-8a93-c749d0703ecf tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 66dd80a8-8e33-421c-9c4a-200ad720823a] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:11.023608 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b05bad02-d64a-40d2-8a93-c749d0703ecf tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:11.024085 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b05bad02-d64a-40d2-8a93-c749d0703ecf tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:11.024516 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b05bad02-d64a-40d2-8a93-c749d0703ecf tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:11.025204 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b05bad02-d64a-40d2-8a93-c749d0703ecf tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:11.025654 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b05bad02-d64a-40d2-8a93-c749d0703ecf tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:11.026073 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b05bad02-d64a-40d2-8a93-c749d0703ecf tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:11.056482 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-b05bad02-d64a-40d2-8a93-c749d0703ecf tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045393 Aug 24 03:59:11.057054 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 443/883] 10.222.0.82 () {58 vars in 1302 bytes} [Wed Aug 24 03:59:11 2022] GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:59:11.157043 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a8f16aa8-8e71-4430-b20c-aed6a69f675f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:11.157676 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a8f16aa8-8e71-4430-b20c-aed6a69f675f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: a362c623-fa9a-4da0-b8f5-64233f2651ba] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:11.166217 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8f16aa8-8e71-4430-b20c-aed6a69f675f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:11.166754 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8f16aa8-8e71-4430-b20c-aed6a69f675f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:11.167342 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8f16aa8-8e71-4430-b20c-aed6a69f675f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:11.168098 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8f16aa8-8e71-4430-b20c-aed6a69f675f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:11.168557 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8f16aa8-8e71-4430-b20c-aed6a69f675f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:11.168988 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a8f16aa8-8e71-4430-b20c-aed6a69f675f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:11.341373 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-a8f16aa8-8e71-4430-b20c-aed6a69f675f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:11.349657 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a8f16aa8-8e71-4430-b20c-aed6a69f675f tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba" status: 200 len: 1673 microversion: 2.1 time: 0.197907 Aug 24 03:59:11.350712 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 441/884] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:11 2022] GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba => generated 1673 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:11.984320 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-575ca731-2123-4efa-bd4a-f6d77c1634d7 req-29aa1ce4-10f0-41a0-ab9b-62c4fe37c841 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a362c623-fa9a-4da0-b8f5-64233f2651ba", "name": "network-vif-deleted", "tag": "f8530983-e556-4b26-9386-08d90e5ab898"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:59:12.004225 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-575ca731-2123-4efa-bd4a-f6d77c1634d7 req-29aa1ce4-10f0-41a0-ab9b-62c4fe37c841 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:12.004705 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-575ca731-2123-4efa-bd4a-f6d77c1634d7 req-29aa1ce4-10f0-41a0-ab9b-62c4fe37c841 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:12.005128 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-575ca731-2123-4efa-bd4a-f6d77c1634d7 req-29aa1ce4-10f0-41a0-ab9b-62c4fe37c841 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:12.020190 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-575ca731-2123-4efa-bd4a-f6d77c1634d7 req-29aa1ce4-10f0-41a0-ab9b-62c4fe37c841 service nova] Creating event network-vif-deleted:f8530983-e556-4b26-9386-08d90e5ab898 for instance a362c623-fa9a-4da0-b8f5-64233f2651ba on hv-cinder-85426 Aug 24 03:59:12.027152 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-575ca731-2123-4efa-bd4a-f6d77c1634d7 req-29aa1ce4-10f0-41a0-ab9b-62c4fe37c841 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047894 Aug 24 03:59:12.027761 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 444/885] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:59:12.068996 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-633ba778-3fcd-4752-840f-b1e59a9e26fe tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:12.071898 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-633ba778-3fcd-4752-840f-b1e59a9e26fe tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 66dd80a8-8e33-421c-9c4a-200ad720823a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:12.078381 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-633ba778-3fcd-4752-840f-b1e59a9e26fe tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:12.079179 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-633ba778-3fcd-4752-840f-b1e59a9e26fe tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:12.079851 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-633ba778-3fcd-4752-840f-b1e59a9e26fe tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:12.080769 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-633ba778-3fcd-4752-840f-b1e59a9e26fe tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:12.081493 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-633ba778-3fcd-4752-840f-b1e59a9e26fe tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:12.082115 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-633ba778-3fcd-4752-840f-b1e59a9e26fe tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:12.116961 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-633ba778-3fcd-4752-840f-b1e59a9e26fe tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051903 Aug 24 03:59:12.117611 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 442/886] 10.222.0.82 () {58 vars in 1302 bytes} [Wed Aug 24 03:59:12 2022] GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:59:12.186952 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-b28aa3b4-df56-44f9-b6ab-ac823a12e40e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:12.189463 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-b28aa3b4-df56-44f9-b6ab-ac823a12e40e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 66dd80a8-8e33-421c-9c4a-200ad720823a] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:12.196434 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b28aa3b4-df56-44f9-b6ab-ac823a12e40e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:12.196926 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b28aa3b4-df56-44f9-b6ab-ac823a12e40e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:12.197357 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b28aa3b4-df56-44f9-b6ab-ac823a12e40e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:12.198054 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b28aa3b4-df56-44f9-b6ab-ac823a12e40e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:12.198523 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b28aa3b4-df56-44f9-b6ab-ac823a12e40e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:12.198951 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b28aa3b4-df56-44f9-b6ab-ac823a12e40e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:12.226113 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-b28aa3b4-df56-44f9-b6ab-ac823a12e40e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 66dd80a8-8e33-421c-9c4a-200ad720823a] Going to try to terminate instance {{(pid=127869) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:59:12.372599 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8288a9f3-abfd-47c2-98fd-2718a09811b7 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:12.373239 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8288a9f3-abfd-47c2-98fd-2718a09811b7 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: a362c623-fa9a-4da0-b8f5-64233f2651ba] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:12.380775 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8288a9f3-abfd-47c2-98fd-2718a09811b7 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:12.381264 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8288a9f3-abfd-47c2-98fd-2718a09811b7 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:12.382613 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8288a9f3-abfd-47c2-98fd-2718a09811b7 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:12.384075 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8288a9f3-abfd-47c2-98fd-2718a09811b7 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:12.384961 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8288a9f3-abfd-47c2-98fd-2718a09811b7 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:12.385900 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8288a9f3-abfd-47c2-98fd-2718a09811b7 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:12.442042 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-b28aa3b4-df56-44f9-b6ab-ac823a12e40e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "DELETE /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a" status: 204 len: 0 microversion: 2.1 time: 0.259581 Aug 24 03:59:12.446328 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 445/887] 10.222.0.82 () {58 vars in 1239 bytes} [Wed Aug 24 03:59:12 2022] DELETE /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:59:12.452491 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-f1d2c23a-abcf-406e-a5c3-4fbc6e54940f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:12.454674 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-f1d2c23a-abcf-406e-a5c3-4fbc6e54940f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 66dd80a8-8e33-421c-9c4a-200ad720823a] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:12.462789 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f1d2c23a-abcf-406e-a5c3-4fbc6e54940f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:12.463548 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f1d2c23a-abcf-406e-a5c3-4fbc6e54940f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:12.463983 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f1d2c23a-abcf-406e-a5c3-4fbc6e54940f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:12.464715 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f1d2c23a-abcf-406e-a5c3-4fbc6e54940f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:12.465323 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f1d2c23a-abcf-406e-a5c3-4fbc6e54940f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:12.465903 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f1d2c23a-abcf-406e-a5c3-4fbc6e54940f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:12.497825 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-8288a9f3-abfd-47c2-98fd-2718a09811b7 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:12.513462 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8288a9f3-abfd-47c2-98fd-2718a09811b7 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba" status: 200 len: 1322 microversion: 2.1 time: 0.145260 Aug 24 03:59:12.514298 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 443/888] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:12 2022] GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:59:12.629368 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-f1d2c23a-abcf-406e-a5c3-4fbc6e54940f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:12.637609 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-f1d2c23a-abcf-406e-a5c3-4fbc6e54940f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a" status: 200 len: 1684 microversion: 2.1 time: 0.190020 Aug 24 03:59:12.638184 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 446/889] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:12 2022] GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a => generated 1684 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:13.535302 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-17c3d405-ed60-4df4-9056-7e30316f0a51 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:13.535916 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-17c3d405-ed60-4df4-9056-7e30316f0a51 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: a362c623-fa9a-4da0-b8f5-64233f2651ba] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:13.542423 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-17c3d405-ed60-4df4-9056-7e30316f0a51 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:13.542931 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-17c3d405-ed60-4df4-9056-7e30316f0a51 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:13.543361 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-17c3d405-ed60-4df4-9056-7e30316f0a51 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:13.544045 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-17c3d405-ed60-4df4-9056-7e30316f0a51 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:13.544490 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-17c3d405-ed60-4df4-9056-7e30316f0a51 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:13.544905 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-17c3d405-ed60-4df4-9056-7e30316f0a51 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:13.576533 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-17c3d405-ed60-4df4-9056-7e30316f0a51 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:13.576988 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-17c3d405-ed60-4df4-9056-7e30316f0a51 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:13.577419 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-17c3d405-ed60-4df4-9056-7e30316f0a51 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:13.578099 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-17c3d405-ed60-4df4-9056-7e30316f0a51 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lazy-loading 'fault' on Instance uuid a362c623-fa9a-4da0-b8f5-64233f2651ba {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:59:13.622755 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-17c3d405-ed60-4df4-9056-7e30316f0a51 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:13.631583 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-17c3d405-ed60-4df4-9056-7e30316f0a51 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba" status: 200 len: 1327 microversion: 2.1 time: 0.100862 Aug 24 03:59:13.632237 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 444/890] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:13 2022] GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba => generated 1327 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:13.660215 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-28d9cc59-3aca-47c9-9523-9144eb6c3d1d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:13.660832 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-28d9cc59-3aca-47c9-9523-9144eb6c3d1d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 66dd80a8-8e33-421c-9c4a-200ad720823a] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:13.667297 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-28d9cc59-3aca-47c9-9523-9144eb6c3d1d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:13.667771 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-28d9cc59-3aca-47c9-9523-9144eb6c3d1d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:13.668200 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-28d9cc59-3aca-47c9-9523-9144eb6c3d1d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:13.668881 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-28d9cc59-3aca-47c9-9523-9144eb6c3d1d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:13.669325 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-28d9cc59-3aca-47c9-9523-9144eb6c3d1d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:13.669742 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-28d9cc59-3aca-47c9-9523-9144eb6c3d1d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:13.811919 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-28d9cc59-3aca-47c9-9523-9144eb6c3d1d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:13.820145 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-28d9cc59-3aca-47c9-9523-9144eb6c3d1d tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a" status: 200 len: 1684 microversion: 2.1 time: 0.163757 Aug 24 03:59:13.820700 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 447/891] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:13 2022] GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:14.653225 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e7af81cb-95b0-498a-8f9d-2b161249cb2a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:14.653849 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e7af81cb-95b0-498a-8f9d-2b161249cb2a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: a362c623-fa9a-4da0-b8f5-64233f2651ba] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:14.661121 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7af81cb-95b0-498a-8f9d-2b161249cb2a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:14.662881 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7af81cb-95b0-498a-8f9d-2b161249cb2a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:14.662881 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7af81cb-95b0-498a-8f9d-2b161249cb2a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:14.662881 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7af81cb-95b0-498a-8f9d-2b161249cb2a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:14.667780 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7af81cb-95b0-498a-8f9d-2b161249cb2a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:14.668571 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7af81cb-95b0-498a-8f9d-2b161249cb2a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:14.702055 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7af81cb-95b0-498a-8f9d-2b161249cb2a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:14.702732 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7af81cb-95b0-498a-8f9d-2b161249cb2a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:14.703270 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e7af81cb-95b0-498a-8f9d-2b161249cb2a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:14.703820 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-e7af81cb-95b0-498a-8f9d-2b161249cb2a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lazy-loading 'fault' on Instance uuid a362c623-fa9a-4da0-b8f5-64233f2651ba {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:59:14.746684 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-e7af81cb-95b0-498a-8f9d-2b161249cb2a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e29563153a4ecbbe7447bed0324df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb802f52e1140d488ff0c6d739cd0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:14.755098 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e7af81cb-95b0-498a-8f9d-2b161249cb2a tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba" status: 200 len: 1327 microversion: 2.1 time: 0.105580 Aug 24 03:59:14.755657 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 445/892] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:14 2022] GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba => generated 1327 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:14.841514 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-5700c9cd-8b91-49d9-9680-6aca9c87bbbf tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:14.842164 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-5700c9cd-8b91-49d9-9680-6aca9c87bbbf tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 66dd80a8-8e33-421c-9c4a-200ad720823a] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:14.849523 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5700c9cd-8b91-49d9-9680-6aca9c87bbbf tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:14.850007 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5700c9cd-8b91-49d9-9680-6aca9c87bbbf tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:14.850439 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5700c9cd-8b91-49d9-9680-6aca9c87bbbf tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:14.851159 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5700c9cd-8b91-49d9-9680-6aca9c87bbbf tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:14.851610 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5700c9cd-8b91-49d9-9680-6aca9c87bbbf tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:14.852032 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5700c9cd-8b91-49d9-9680-6aca9c87bbbf tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:14.990817 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-5700c9cd-8b91-49d9-9680-6aca9c87bbbf tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:14.998792 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-5700c9cd-8b91-49d9-9680-6aca9c87bbbf tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a" status: 200 len: 1684 microversion: 2.1 time: 0.161070 Aug 24 03:59:14.999385 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 448/893] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:14 2022] GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a => generated 1684 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:15.765317 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-51a907fe-e592-4a82-b4b8-18cbfb3dff58 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a40551c5-e659-43ab-84dc-5ca9d9577bdd", "device": "/dev/sdb"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:59:15.768282 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-51a907fe-e592-4a82-b4b8-18cbfb3dff58 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 6052f56c-fecc-42d7-a99a-e192c776be59] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:15.777601 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-c894b428-4d55-4644-bd22-7d42ae516c0e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:15.778293 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-c894b428-4d55-4644-bd22-7d42ae516c0e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: a362c623-fa9a-4da0-b8f5-64233f2651ba] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:15.780696 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-51a907fe-e592-4a82-b4b8-18cbfb3dff58 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:15.781191 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-51a907fe-e592-4a82-b4b8-18cbfb3dff58 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:15.781664 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-51a907fe-e592-4a82-b4b8-18cbfb3dff58 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:15.782368 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-51a907fe-e592-4a82-b4b8-18cbfb3dff58 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:15.783379 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-51a907fe-e592-4a82-b4b8-18cbfb3dff58 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:15.784006 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-51a907fe-e592-4a82-b4b8-18cbfb3dff58 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:15.785457 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c894b428-4d55-4644-bd22-7d42ae516c0e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:15.785950 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c894b428-4d55-4644-bd22-7d42ae516c0e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:15.786408 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c894b428-4d55-4644-bd22-7d42ae516c0e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:15.787151 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c894b428-4d55-4644-bd22-7d42ae516c0e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:15.787944 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c894b428-4d55-4644-bd22-7d42ae516c0e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:15.788711 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c894b428-4d55-4644-bd22-7d42ae516c0e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:15.805536 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.wsgi [None req-c894b428-4d55-4644-bd22-7d42ae516c0e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] HTTP exception thrown: Instance a362c623-fa9a-4da0-b8f5-64233f2651ba could not be found. Aug 24 03:59:15.807244 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-c894b428-4d55-4644-bd22-7d42ae516c0e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Request method failure captured: Aug 24 03:59:15.807244 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: request: GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba HTTP/1.1 Aug 24 03:59:15.807244 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept: application/json Aug 24 03:59:15.807244 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept-Encoding: identity Aug 24 03:59:15.807244 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Connection: close Aug 24 03:59:15.807244 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Length: 0 Aug 24 03:59:15.807244 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Type: application/json Aug 24 03:59:15.807244 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Host: 10.222.0.82 Aug 24 03:59:15.807244 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Openstack-System-Scope: None Aug 24 03:59:15.807244 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: User-Agent: python-urllib3/1.26.11 Aug 24 03:59:15.807244 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Auth-Token: gAAAAABjBaB1cjCRnkMdHT63ADEXIl04mKhwJKM8oB9_h50wLjevdzc0b0dxIWZS5wG2Ps-xU1gmr2cQNGh_Jy8xgNCbrBWwOVouw_UcERGGMkxy0MkStgJZtLDlrU4C8PdZSSvTSNljq4C40rGVOwds8ysCUWQ6A06SBL2ZgzFe5zxFM_wEzTc Aug 24 03:59:15.807244 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Id: None Aug 24 03:59:15.807244 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Name: None Aug 24 03:59:15.807244 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Identity-Status: Confirmed Aug 24 03:59:15.807244 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Is-Admin-Project: True Aug 24 03:59:15.807244 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Id: default Aug 24 03:59:15.807244 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Name: Default Aug 24 03:59:15.807244 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Id: bdb802f52e1140d488ff0c6d739cd0d1 Aug 24 03:59:15.807244 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Name: tempest-AttachVolumeTestJSON-642371474 Aug 24 03:59:15.807244 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Role: member,reader Aug 24 03:59:15.807244 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Roles: member,reader Aug 24 03:59:15.808953 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/bdb802f52e1140d488ff0c6d739cd0d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/bdb802f52e1140d488ff0c6d739cd0d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/bdb802f52e1140d488ff0c6d739cd0d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_bdb802f52e1140d488ff0c6d739cd0d1", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:59:15.808953 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant: tempest-AttachVolumeTestJSON-642371474 Aug 24 03:59:15.808953 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Id: bdb802f52e1140d488ff0c6d739cd0d1 Aug 24 03:59:15.808953 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Name: tempest-AttachVolumeTestJSON-642371474 Aug 24 03:59:15.808953 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User: tempest-AttachVolumeTestJSON-642371474-project Aug 24 03:59:15.808953 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Id: default Aug 24 03:59:15.808953 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Name: Default Aug 24 03:59:15.808953 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Id: c7e29563153a4ecbbe7447bed0324df7 Aug 24 03:59:15.808953 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Name: tempest-AttachVolumeTestJSON-642371474-project Aug 24 03:59:15.808953 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: method: > Aug 24 03:59:15.808953 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: exception: Instance a362c623-fa9a-4da0-b8f5-64233f2651ba could not be found. Aug 24 03:59:15.808953 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: action_args: {'id': 'a362c623-fa9a-4da0-b8f5-64233f2651ba'} Aug 24 03:59:15.809865 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:59:15.809865 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:15.809865 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:59:15.809865 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:59:15.809865 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:59:15.809865 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:59:15.809865 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:59:15.809865 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:59:15.809865 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:59:15.809865 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:59:15.809865 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a362c623-fa9a-4da0-b8f5-64233f2651ba could not be found. Aug 24 03:59:15.809865 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:15.809865 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:15.809865 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:15.809865 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:15.809865 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:15.809865 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:15.809865 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:59:15.809865 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:59:15.809865 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:59:15.811251 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:59:15.811251 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:59:15.811251 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:59:15.811251 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:59:15.811251 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:59:15.811251 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:59:15.811251 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:59:15.811251 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a362c623-fa9a-4da0-b8f5-64233f2651ba could not be found. Aug 24 03:59:15.811251 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:15.811251 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:15.811251 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:15.811251 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:15.811251 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:15.811251 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:15.811251 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:59:15.811251 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:59:15.811251 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a362c623-fa9a-4da0-b8f5-64233f2651ba could not be found. Aug 24 03:59:15.811251 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:15.812416 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-c894b428-4d55-4644-bd22-7d42ae516c0e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Returning 404 to user: Instance a362c623-fa9a-4da0-b8f5-64233f2651ba could not be found. {{(pid=127869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:59:15.812416 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-c894b428-4d55-4644-bd22-7d42ae516c0e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba" status: 404 len: 111 microversion: 2.1 time: 0.035898 Aug 24 03:59:15.812416 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 449/894] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:15 2022] GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:59:15.818532 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-eff3242f-bcf0-4a9f-b177-01f34204e337 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '.version_select at 0x7f1554184ee0>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:15.899076 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-eff3242f-bcf0-4a9f-b177-01f34204e337 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1091142487" status: 202 len: 0 microversion: 2.1 time: 0.085089 Aug 24 03:59:15.904786 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 450/895] 10.222.0.82 () {58 vars in 1221 bytes} [Wed Aug 24 03:59:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1091142487 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:59:16.027167 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-4199ff05-c69e-4ce3-9dee-1393ea55b0d7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:16.027784 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-4199ff05-c69e-4ce3-9dee-1393ea55b0d7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 66dd80a8-8e33-421c-9c4a-200ad720823a] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:16.040176 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4199ff05-c69e-4ce3-9dee-1393ea55b0d7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:16.041733 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4199ff05-c69e-4ce3-9dee-1393ea55b0d7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:16.041733 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4199ff05-c69e-4ce3-9dee-1393ea55b0d7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:16.041953 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4199ff05-c69e-4ce3-9dee-1393ea55b0d7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:16.042346 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4199ff05-c69e-4ce3-9dee-1393ea55b0d7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:16.042957 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4199ff05-c69e-4ce3-9dee-1393ea55b0d7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:16.424846 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-4199ff05-c69e-4ce3-9dee-1393ea55b0d7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:16.433918 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-4199ff05-c69e-4ce3-9dee-1393ea55b0d7 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a" status: 200 len: 1616 microversion: 2.1 time: 0.416647 Aug 24 03:59:16.441245 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 451/896] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:16 2022] GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a => generated 1616 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:16.524518 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-3bcb2925-8e67-48cf-a269-00e58b1b1bea req-5c4d3aaa-3156-4401-a2b5-ee963f00e87a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66dd80a8-8e33-421c-9c4a-200ad720823a", "name": "network-vif-deleted", "tag": "84ac01da-84a3-455a-9de0-78bfa8ece981"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:59:16.538008 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-3bcb2925-8e67-48cf-a269-00e58b1b1bea req-5c4d3aaa-3156-4401-a2b5-ee963f00e87a service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:16.539001 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-3bcb2925-8e67-48cf-a269-00e58b1b1bea req-5c4d3aaa-3156-4401-a2b5-ee963f00e87a service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:16.539605 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-3bcb2925-8e67-48cf-a269-00e58b1b1bea req-5c4d3aaa-3156-4401-a2b5-ee963f00e87a service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:16.553541 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-3bcb2925-8e67-48cf-a269-00e58b1b1bea req-5c4d3aaa-3156-4401-a2b5-ee963f00e87a service nova] Creating event network-vif-deleted:84ac01da-84a3-455a-9de0-78bfa8ece981 for instance 66dd80a8-8e33-421c-9c4a-200ad720823a on hv-cinder-85426 Aug 24 03:59:16.559133 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-3bcb2925-8e67-48cf-a269-00e58b1b1bea req-5c4d3aaa-3156-4401-a2b5-ee963f00e87a service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042618 Aug 24 03:59:16.559874 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 452/897] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:59:16.704461 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-51a907fe-e592-4a82-b4b8-18cbfb3dff58 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "POST /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.952192 Aug 24 03:59:16.711562 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 446/898] 10.222.0.82 () {60 vars in 1323 bytes} [Wed Aug 24 03:59:15 2022] POST /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59/os-volume_attachments => generated 194 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:59:17.457816 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-41f891ae-1f5d-4717-9073-c5392cef3673 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:17.458527 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-41f891ae-1f5d-4717-9073-c5392cef3673 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 66dd80a8-8e33-421c-9c4a-200ad720823a] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:17.467071 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-41f891ae-1f5d-4717-9073-c5392cef3673 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:17.475416 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-41f891ae-1f5d-4717-9073-c5392cef3673 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:17.475416 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-41f891ae-1f5d-4717-9073-c5392cef3673 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:17.475416 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-41f891ae-1f5d-4717-9073-c5392cef3673 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:17.475416 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-41f891ae-1f5d-4717-9073-c5392cef3673 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:17.475795 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-41f891ae-1f5d-4717-9073-c5392cef3673 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:17.506451 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-41f891ae-1f5d-4717-9073-c5392cef3673 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:17.506973 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-41f891ae-1f5d-4717-9073-c5392cef3673 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:17.507411 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-41f891ae-1f5d-4717-9073-c5392cef3673 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:17.507860 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.objects.instance [None req-41f891ae-1f5d-4717-9073-c5392cef3673 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lazy-loading 'fault' on Instance uuid 66dd80a8-8e33-421c-9c4a-200ad720823a {{(pid=127869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:59:17.551785 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-41f891ae-1f5d-4717-9073-c5392cef3673 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5582d10ebef459084fe287c18568f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ef5b02d8da4d2eac26b6ccfb35e1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:17.559460 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-41f891ae-1f5d-4717-9073-c5392cef3673 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a" status: 200 len: 1332 microversion: 2.1 time: 0.107275 Aug 24 03:59:17.560341 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 453/899] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:17 2022] GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a => generated 1332 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:18.588666 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-af59dfb7-1bee-420c-8425-0bcc0976634f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:18.589360 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-af59dfb7-1bee-420c-8425-0bcc0976634f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 66dd80a8-8e33-421c-9c4a-200ad720823a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:18.591312 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=54 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:18.597045 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-af59dfb7-1bee-420c-8425-0bcc0976634f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:18.597527 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-af59dfb7-1bee-420c-8425-0bcc0976634f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:18.597962 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-af59dfb7-1bee-420c-8425-0bcc0976634f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:18.598682 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-af59dfb7-1bee-420c-8425-0bcc0976634f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:18.599163 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-af59dfb7-1bee-420c-8425-0bcc0976634f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:18.620446 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-af59dfb7-1bee-420c-8425-0bcc0976634f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:18.620446 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-af59dfb7-1bee-420c-8425-0bcc0976634f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] HTTP exception thrown: Instance 66dd80a8-8e33-421c-9c4a-200ad720823a could not be found. Aug 24 03:59:18.620446 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-af59dfb7-1bee-420c-8425-0bcc0976634f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Request method failure captured: Aug 24 03:59:18.620446 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a HTTP/1.1 Aug 24 03:59:18.620446 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept: application/json Aug 24 03:59:18.620446 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept-Encoding: identity Aug 24 03:59:18.620446 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Connection: close Aug 24 03:59:18.620446 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Length: 0 Aug 24 03:59:18.620446 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Type: application/json Aug 24 03:59:18.620446 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Host: 10.222.0.82 Aug 24 03:59:18.620446 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Openstack-System-Scope: None Aug 24 03:59:18.620446 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.11 Aug 24 03:59:18.620446 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Auth-Token: gAAAAABjBaByYUQ7dP595ip40_OJ_0ufC71Rc-FPYS4vZXmmx4Fislhg9iz6FfvLLHiwJ4Ed0bFNDX6fhqS1zmk_A3EKqVLHT9Pz2gZaaIcE0OalzJoOw2sqfwO-7iDYasbxHIEhvzvTJNavoRaspbu_b6_R5EZ70Pa8SKRgBtFA8vqfpAdszSk Aug 24 03:59:18.620446 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Id: None Aug 24 03:59:18.620446 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Name: None Aug 24 03:59:18.620446 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Identity-Status: Confirmed Aug 24 03:59:18.620446 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Is-Admin-Project: True Aug 24 03:59:18.620446 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Id: default Aug 24 03:59:18.620446 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Name: Default Aug 24 03:59:18.620446 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Id: 46ef5b02d8da4d2eac26b6ccfb35e1a4 Aug 24 03:59:18.620446 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Name: tempest-AttachVolumeNegativeTest-477133645 Aug 24 03:59:18.620446 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Role: member,reader Aug 24 03:59:18.620446 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Roles: member,reader Aug 24 03:59:18.622200 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/46ef5b02d8da4d2eac26b6ccfb35e1a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/46ef5b02d8da4d2eac26b6ccfb35e1a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/46ef5b02d8da4d2eac26b6ccfb35e1a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_46ef5b02d8da4d2eac26b6ccfb35e1a4", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:59:18.622200 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant: tempest-AttachVolumeNegativeTest-477133645 Aug 24 03:59:18.622200 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Id: 46ef5b02d8da4d2eac26b6ccfb35e1a4 Aug 24 03:59:18.622200 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-477133645 Aug 24 03:59:18.622200 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User: tempest-AttachVolumeNegativeTest-477133645-project Aug 24 03:59:18.622200 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Id: default Aug 24 03:59:18.622200 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Name: Default Aug 24 03:59:18.622200 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Id: e5582d10ebef459084fe287c18568f98 Aug 24 03:59:18.622200 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Name: tempest-AttachVolumeNegativeTest-477133645-project Aug 24 03:59:18.622200 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: method: > Aug 24 03:59:18.622200 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: exception: Instance 66dd80a8-8e33-421c-9c4a-200ad720823a could not be found. Aug 24 03:59:18.622200 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: action_args: {'id': '66dd80a8-8e33-421c-9c4a-200ad720823a'} Aug 24 03:59:18.623155 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:59:18.623155 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:18.623155 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:59:18.623155 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:59:18.623155 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:59:18.623155 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:59:18.623155 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:59:18.623155 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:59:18.623155 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:59:18.623155 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:59:18.623155 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66dd80a8-8e33-421c-9c4a-200ad720823a could not be found. Aug 24 03:59:18.623155 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:18.623155 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:18.623155 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:18.623155 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:18.623155 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:18.623155 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:18.623155 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:59:18.623155 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:59:18.623155 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:59:18.624418 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:59:18.624418 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:59:18.624418 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:59:18.624418 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:59:18.624418 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:59:18.624418 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:59:18.624418 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:59:18.624418 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66dd80a8-8e33-421c-9c4a-200ad720823a could not be found. Aug 24 03:59:18.624418 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:18.624418 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:18.624418 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:18.624418 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:18.624418 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:18.624418 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:18.624418 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:59:18.624418 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:59:18.624418 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66dd80a8-8e33-421c-9c4a-200ad720823a could not be found. Aug 24 03:59:18.624418 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:18.625490 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-af59dfb7-1bee-420c-8425-0bcc0976634f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Returning 404 to user: Instance 66dd80a8-8e33-421c-9c4a-200ad720823a could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:59:18.625490 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-af59dfb7-1bee-420c-8425-0bcc0976634f tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a" status: 404 len: 111 microversion: 2.1 time: 0.032288 Aug 24 03:59:18.625490 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 447/900] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:18 2022] GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:59:18.625708 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-8b704efa-072b-4a37-987a-3b389dfeb57e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '.version_select at 0x7f1554184940>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:18.780940 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-8b704efa-072b-4a37-987a-3b389dfeb57e tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1149729991" status: 202 len: 0 microversion: 2.1 time: 0.158268 Aug 24 03:59:18.781804 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 454/901] 10.222.0.82 () {58 vars in 1221 bytes} [Wed Aug 24 03:59:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1149729991 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:59:19.822665 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e78eb4d8-7028-4582-8f04-19e58d4ed92e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:19.823146 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e78eb4d8-7028-4582-8f04-19e58d4ed92e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: a362c623-fa9a-4da0-b8f5-64233f2651ba] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:19.830974 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e78eb4d8-7028-4582-8f04-19e58d4ed92e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:19.837406 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e78eb4d8-7028-4582-8f04-19e58d4ed92e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:19.837406 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e78eb4d8-7028-4582-8f04-19e58d4ed92e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:19.837406 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e78eb4d8-7028-4582-8f04-19e58d4ed92e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:19.837406 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e78eb4d8-7028-4582-8f04-19e58d4ed92e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:19.838048 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e78eb4d8-7028-4582-8f04-19e58d4ed92e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:19.849969 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-e78eb4d8-7028-4582-8f04-19e58d4ed92e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] HTTP exception thrown: Instance a362c623-fa9a-4da0-b8f5-64233f2651ba could not be found. Aug 24 03:59:19.851547 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e78eb4d8-7028-4582-8f04-19e58d4ed92e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Request method failure captured: Aug 24 03:59:19.851547 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba HTTP/1.1 Aug 24 03:59:19.851547 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept: application/json Aug 24 03:59:19.851547 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept-Encoding: identity Aug 24 03:59:19.851547 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Connection: close Aug 24 03:59:19.851547 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Length: 0 Aug 24 03:59:19.851547 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Type: application/json Aug 24 03:59:19.851547 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Host: 10.222.0.82 Aug 24 03:59:19.851547 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Openstack-System-Scope: None Aug 24 03:59:19.851547 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.11 Aug 24 03:59:19.851547 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Auth-Token: gAAAAABjBaB1cjCRnkMdHT63ADEXIl04mKhwJKM8oB9_h50wLjevdzc0b0dxIWZS5wG2Ps-xU1gmr2cQNGh_Jy8xgNCbrBWwOVouw_UcERGGMkxy0MkStgJZtLDlrU4C8PdZSSvTSNljq4C40rGVOwds8ysCUWQ6A06SBL2ZgzFe5zxFM_wEzTc Aug 24 03:59:19.851547 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Id: None Aug 24 03:59:19.851547 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Name: None Aug 24 03:59:19.851547 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Identity-Status: Confirmed Aug 24 03:59:19.851547 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Is-Admin-Project: True Aug 24 03:59:19.851547 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Id: default Aug 24 03:59:19.851547 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Name: Default Aug 24 03:59:19.851547 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Id: bdb802f52e1140d488ff0c6d739cd0d1 Aug 24 03:59:19.851547 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Name: tempest-AttachVolumeTestJSON-642371474 Aug 24 03:59:19.851547 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Role: member,reader Aug 24 03:59:19.851547 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Roles: member,reader Aug 24 03:59:19.853082 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/bdb802f52e1140d488ff0c6d739cd0d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/bdb802f52e1140d488ff0c6d739cd0d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/bdb802f52e1140d488ff0c6d739cd0d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_bdb802f52e1140d488ff0c6d739cd0d1", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:59:19.853082 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant: tempest-AttachVolumeTestJSON-642371474 Aug 24 03:59:19.853082 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Id: bdb802f52e1140d488ff0c6d739cd0d1 Aug 24 03:59:19.853082 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Name: tempest-AttachVolumeTestJSON-642371474 Aug 24 03:59:19.853082 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User: tempest-AttachVolumeTestJSON-642371474-project Aug 24 03:59:19.853082 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Id: default Aug 24 03:59:19.853082 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Name: Default Aug 24 03:59:19.853082 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Id: c7e29563153a4ecbbe7447bed0324df7 Aug 24 03:59:19.853082 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Name: tempest-AttachVolumeTestJSON-642371474-project Aug 24 03:59:19.853082 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: method: > Aug 24 03:59:19.853082 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: exception: Instance a362c623-fa9a-4da0-b8f5-64233f2651ba could not be found. Aug 24 03:59:19.853082 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: action_args: {'id': 'a362c623-fa9a-4da0-b8f5-64233f2651ba'} Aug 24 03:59:19.853880 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:59:19.853880 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:19.853880 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:59:19.853880 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:59:19.853880 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:59:19.853880 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:59:19.853880 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:59:19.853880 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:59:19.853880 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:59:19.853880 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:59:19.853880 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a362c623-fa9a-4da0-b8f5-64233f2651ba could not be found. Aug 24 03:59:19.853880 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:19.853880 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:19.853880 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:19.853880 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:19.853880 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:19.853880 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:19.853880 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:59:19.853880 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:59:19.853880 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:59:19.856061 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:59:19.856061 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:59:19.856061 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:59:19.856061 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:59:19.856061 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:59:19.856061 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:59:19.856061 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:59:19.856061 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:59:19.856061 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:59:19.856061 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a362c623-fa9a-4da0-b8f5-64233f2651ba could not be found. Aug 24 03:59:19.856061 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:19.856061 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:19.856061 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:19.856061 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:19.856061 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:19.856061 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:19.856061 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:59:19.856061 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:59:19.856061 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a362c623-fa9a-4da0-b8f5-64233f2651ba could not be found. Aug 24 03:59:19.856061 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:19.858486 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e78eb4d8-7028-4582-8f04-19e58d4ed92e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Returning 404 to user: Instance a362c623-fa9a-4da0-b8f5-64233f2651ba could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:59:19.858486 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e78eb4d8-7028-4582-8f04-19e58d4ed92e tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "DELETE /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba" status: 404 len: 111 microversion: 2.1 time: 0.034529 Aug 24 03:59:19.858486 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 448/902] 10.222.0.82 () {58 vars in 1239 bytes} [Wed Aug 24 03:59:19 2022] DELETE /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:59:19.868985 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-6fb52689-9e0a-4524-b782-0846b5b32064 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:19.869605 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-6fb52689-9e0a-4524-b782-0846b5b32064 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: a362c623-fa9a-4da0-b8f5-64233f2651ba] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:19.876265 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6fb52689-9e0a-4524-b782-0846b5b32064 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:19.876751 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6fb52689-9e0a-4524-b782-0846b5b32064 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:19.877187 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6fb52689-9e0a-4524-b782-0846b5b32064 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:19.877910 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6fb52689-9e0a-4524-b782-0846b5b32064 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:19.878945 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6fb52689-9e0a-4524-b782-0846b5b32064 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:19.879079 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6fb52689-9e0a-4524-b782-0846b5b32064 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:19.892582 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.wsgi [None req-6fb52689-9e0a-4524-b782-0846b5b32064 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] HTTP exception thrown: Instance a362c623-fa9a-4da0-b8f5-64233f2651ba could not be found. Aug 24 03:59:19.894216 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-6fb52689-9e0a-4524-b782-0846b5b32064 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Request method failure captured: Aug 24 03:59:19.894216 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: request: GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba HTTP/1.1 Aug 24 03:59:19.894216 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept: application/json Aug 24 03:59:19.894216 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept-Encoding: identity Aug 24 03:59:19.894216 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Connection: close Aug 24 03:59:19.894216 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Length: 0 Aug 24 03:59:19.894216 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Type: application/json Aug 24 03:59:19.894216 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Host: 10.222.0.82 Aug 24 03:59:19.894216 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Openstack-System-Scope: None Aug 24 03:59:19.894216 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: User-Agent: python-urllib3/1.26.11 Aug 24 03:59:19.894216 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Auth-Token: gAAAAABjBaB1cjCRnkMdHT63ADEXIl04mKhwJKM8oB9_h50wLjevdzc0b0dxIWZS5wG2Ps-xU1gmr2cQNGh_Jy8xgNCbrBWwOVouw_UcERGGMkxy0MkStgJZtLDlrU4C8PdZSSvTSNljq4C40rGVOwds8ysCUWQ6A06SBL2ZgzFe5zxFM_wEzTc Aug 24 03:59:19.894216 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Id: None Aug 24 03:59:19.894216 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Name: None Aug 24 03:59:19.894216 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Identity-Status: Confirmed Aug 24 03:59:19.894216 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Is-Admin-Project: True Aug 24 03:59:19.894216 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Id: default Aug 24 03:59:19.894216 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Name: Default Aug 24 03:59:19.894216 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Id: bdb802f52e1140d488ff0c6d739cd0d1 Aug 24 03:59:19.894216 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Name: tempest-AttachVolumeTestJSON-642371474 Aug 24 03:59:19.894216 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Role: member,reader Aug 24 03:59:19.894216 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Roles: member,reader Aug 24 03:59:19.895697 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/bdb802f52e1140d488ff0c6d739cd0d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/bdb802f52e1140d488ff0c6d739cd0d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/bdb802f52e1140d488ff0c6d739cd0d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_bdb802f52e1140d488ff0c6d739cd0d1", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:59:19.895697 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant: tempest-AttachVolumeTestJSON-642371474 Aug 24 03:59:19.895697 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Id: bdb802f52e1140d488ff0c6d739cd0d1 Aug 24 03:59:19.895697 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Name: tempest-AttachVolumeTestJSON-642371474 Aug 24 03:59:19.895697 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User: tempest-AttachVolumeTestJSON-642371474-project Aug 24 03:59:19.895697 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Id: default Aug 24 03:59:19.895697 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Name: Default Aug 24 03:59:19.895697 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Id: c7e29563153a4ecbbe7447bed0324df7 Aug 24 03:59:19.895697 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Name: tempest-AttachVolumeTestJSON-642371474-project Aug 24 03:59:19.895697 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: method: > Aug 24 03:59:19.895697 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: exception: Instance a362c623-fa9a-4da0-b8f5-64233f2651ba could not be found. Aug 24 03:59:19.895697 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: action_args: {'id': 'a362c623-fa9a-4da0-b8f5-64233f2651ba'} Aug 24 03:59:19.896437 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:59:19.896437 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:19.896437 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:59:19.896437 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:59:19.896437 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:59:19.896437 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:59:19.896437 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:59:19.896437 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:59:19.896437 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:59:19.896437 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:59:19.896437 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a362c623-fa9a-4da0-b8f5-64233f2651ba could not be found. Aug 24 03:59:19.896437 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:19.896437 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:19.896437 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:19.896437 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:19.896437 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:19.896437 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:19.896437 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:59:19.896437 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:59:19.896437 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:59:19.897628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:59:19.897628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:59:19.897628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:59:19.897628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:59:19.897628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:59:19.897628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:59:19.897628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:59:19.897628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a362c623-fa9a-4da0-b8f5-64233f2651ba could not be found. Aug 24 03:59:19.897628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:19.897628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:19.897628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:19.897628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:19.897628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:19.897628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:19.897628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:59:19.897628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:59:19.897628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a362c623-fa9a-4da0-b8f5-64233f2651ba could not be found. Aug 24 03:59:19.897628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:19.898738 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-6fb52689-9e0a-4524-b782-0846b5b32064 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Returning 404 to user: Instance a362c623-fa9a-4da0-b8f5-64233f2651ba could not be found. {{(pid=127869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:59:19.898738 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-6fb52689-9e0a-4524-b782-0846b5b32064 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba" status: 404 len: 111 microversion: 2.1 time: 0.031040 Aug 24 03:59:19.898738 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 455/903] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:19 2022] GET /compute/v2.1/servers/a362c623-fa9a-4da0-b8f5-64233f2651ba => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:59:20.910238 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4e0fb903-0f52-4714-9e0d-a6498eecaec5 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:20.910978 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4e0fb903-0f52-4714-9e0d-a6498eecaec5 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 66dd80a8-8e33-421c-9c4a-200ad720823a] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:20.917300 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4e0fb903-0f52-4714-9e0d-a6498eecaec5 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:20.917852 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4e0fb903-0f52-4714-9e0d-a6498eecaec5 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:20.918290 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4e0fb903-0f52-4714-9e0d-a6498eecaec5 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:20.919093 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4e0fb903-0f52-4714-9e0d-a6498eecaec5 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:20.919665 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4e0fb903-0f52-4714-9e0d-a6498eecaec5 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:20.920097 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4e0fb903-0f52-4714-9e0d-a6498eecaec5 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:20.935412 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-4e0fb903-0f52-4714-9e0d-a6498eecaec5 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] HTTP exception thrown: Instance 66dd80a8-8e33-421c-9c4a-200ad720823a could not be found. Aug 24 03:59:20.936973 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4e0fb903-0f52-4714-9e0d-a6498eecaec5 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Request method failure captured: Aug 24 03:59:20.936973 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a HTTP/1.1 Aug 24 03:59:20.936973 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept: application/json Aug 24 03:59:20.936973 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept-Encoding: identity Aug 24 03:59:20.936973 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Connection: close Aug 24 03:59:20.936973 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Length: 0 Aug 24 03:59:20.936973 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Type: application/json Aug 24 03:59:20.936973 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Host: 10.222.0.82 Aug 24 03:59:20.936973 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Openstack-System-Scope: None Aug 24 03:59:20.936973 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.11 Aug 24 03:59:20.936973 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Auth-Token: gAAAAABjBaByYUQ7dP595ip40_OJ_0ufC71Rc-FPYS4vZXmmx4Fislhg9iz6FfvLLHiwJ4Ed0bFNDX6fhqS1zmk_A3EKqVLHT9Pz2gZaaIcE0OalzJoOw2sqfwO-7iDYasbxHIEhvzvTJNavoRaspbu_b6_R5EZ70Pa8SKRgBtFA8vqfpAdszSk Aug 24 03:59:20.936973 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Id: None Aug 24 03:59:20.936973 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Name: None Aug 24 03:59:20.936973 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Identity-Status: Confirmed Aug 24 03:59:20.936973 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Is-Admin-Project: True Aug 24 03:59:20.936973 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Id: default Aug 24 03:59:20.936973 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Name: Default Aug 24 03:59:20.936973 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Id: 46ef5b02d8da4d2eac26b6ccfb35e1a4 Aug 24 03:59:20.936973 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Name: tempest-AttachVolumeNegativeTest-477133645 Aug 24 03:59:20.936973 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Role: member,reader Aug 24 03:59:20.936973 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Roles: member,reader Aug 24 03:59:20.938596 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/46ef5b02d8da4d2eac26b6ccfb35e1a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/46ef5b02d8da4d2eac26b6ccfb35e1a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/46ef5b02d8da4d2eac26b6ccfb35e1a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_46ef5b02d8da4d2eac26b6ccfb35e1a4", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:59:20.938596 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant: tempest-AttachVolumeNegativeTest-477133645 Aug 24 03:59:20.938596 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Id: 46ef5b02d8da4d2eac26b6ccfb35e1a4 Aug 24 03:59:20.938596 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-477133645 Aug 24 03:59:20.938596 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User: tempest-AttachVolumeNegativeTest-477133645-project Aug 24 03:59:20.938596 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Id: default Aug 24 03:59:20.938596 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Name: Default Aug 24 03:59:20.938596 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Id: e5582d10ebef459084fe287c18568f98 Aug 24 03:59:20.938596 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Name: tempest-AttachVolumeNegativeTest-477133645-project Aug 24 03:59:20.938596 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: method: > Aug 24 03:59:20.938596 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: exception: Instance 66dd80a8-8e33-421c-9c4a-200ad720823a could not be found. Aug 24 03:59:20.938596 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: action_args: {'id': '66dd80a8-8e33-421c-9c4a-200ad720823a'} Aug 24 03:59:20.939477 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:59:20.939477 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:20.939477 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:59:20.939477 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:59:20.939477 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:59:20.939477 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:59:20.939477 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:59:20.939477 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:59:20.939477 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:59:20.939477 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:59:20.939477 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66dd80a8-8e33-421c-9c4a-200ad720823a could not be found. Aug 24 03:59:20.939477 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:20.939477 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:20.939477 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:20.939477 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:20.939477 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:20.939477 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:20.939477 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:59:20.939477 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:59:20.939477 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:59:20.941005 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:59:20.941005 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:59:20.941005 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:59:20.941005 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:59:20.941005 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:59:20.941005 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:59:20.941005 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:59:20.941005 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:59:20.941005 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:59:20.941005 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66dd80a8-8e33-421c-9c4a-200ad720823a could not be found. Aug 24 03:59:20.941005 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:20.941005 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:20.941005 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:20.941005 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:20.941005 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:20.941005 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:20.941005 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:59:20.941005 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:59:20.941005 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66dd80a8-8e33-421c-9c4a-200ad720823a could not be found. Aug 24 03:59:20.941005 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:20.942550 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4e0fb903-0f52-4714-9e0d-a6498eecaec5 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Returning 404 to user: Instance 66dd80a8-8e33-421c-9c4a-200ad720823a could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:59:20.942550 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4e0fb903-0f52-4714-9e0d-a6498eecaec5 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "DELETE /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a" status: 404 len: 111 microversion: 2.1 time: 0.032939 Aug 24 03:59:20.942550 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 449/904] 10.222.0.82 () {58 vars in 1239 bytes} [Wed Aug 24 03:59:20 2022] DELETE /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:59:20.947830 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-a5b93ada-4674-4c72-af7e-68b88e946d1a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:20.948489 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-a5b93ada-4674-4c72-af7e-68b88e946d1a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 66dd80a8-8e33-421c-9c4a-200ad720823a] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:20.955713 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a5b93ada-4674-4c72-af7e-68b88e946d1a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:20.957989 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a5b93ada-4674-4c72-af7e-68b88e946d1a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:20.957989 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a5b93ada-4674-4c72-af7e-68b88e946d1a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:20.957989 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a5b93ada-4674-4c72-af7e-68b88e946d1a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:20.957989 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a5b93ada-4674-4c72-af7e-68b88e946d1a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:20.958406 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-a5b93ada-4674-4c72-af7e-68b88e946d1a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:20.972900 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.wsgi [None req-a5b93ada-4674-4c72-af7e-68b88e946d1a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] HTTP exception thrown: Instance 66dd80a8-8e33-421c-9c4a-200ad720823a could not be found. Aug 24 03:59:20.974476 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-a5b93ada-4674-4c72-af7e-68b88e946d1a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Request method failure captured: Aug 24 03:59:20.974476 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: request: GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a HTTP/1.1 Aug 24 03:59:20.974476 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept: application/json Aug 24 03:59:20.974476 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept-Encoding: identity Aug 24 03:59:20.974476 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Connection: close Aug 24 03:59:20.974476 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Length: 0 Aug 24 03:59:20.974476 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Type: application/json Aug 24 03:59:20.974476 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Host: 10.222.0.82 Aug 24 03:59:20.974476 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Openstack-System-Scope: None Aug 24 03:59:20.974476 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: User-Agent: python-urllib3/1.26.11 Aug 24 03:59:20.974476 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Auth-Token: gAAAAABjBaByYUQ7dP595ip40_OJ_0ufC71Rc-FPYS4vZXmmx4Fislhg9iz6FfvLLHiwJ4Ed0bFNDX6fhqS1zmk_A3EKqVLHT9Pz2gZaaIcE0OalzJoOw2sqfwO-7iDYasbxHIEhvzvTJNavoRaspbu_b6_R5EZ70Pa8SKRgBtFA8vqfpAdszSk Aug 24 03:59:20.974476 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Id: None Aug 24 03:59:20.974476 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Name: None Aug 24 03:59:20.974476 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Identity-Status: Confirmed Aug 24 03:59:20.974476 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Is-Admin-Project: True Aug 24 03:59:20.974476 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Id: default Aug 24 03:59:20.974476 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Name: Default Aug 24 03:59:20.974476 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Id: 46ef5b02d8da4d2eac26b6ccfb35e1a4 Aug 24 03:59:20.974476 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Name: tempest-AttachVolumeNegativeTest-477133645 Aug 24 03:59:20.974476 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Role: member,reader Aug 24 03:59:20.974476 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Roles: member,reader Aug 24 03:59:20.975824 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/46ef5b02d8da4d2eac26b6ccfb35e1a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/46ef5b02d8da4d2eac26b6ccfb35e1a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/46ef5b02d8da4d2eac26b6ccfb35e1a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_46ef5b02d8da4d2eac26b6ccfb35e1a4", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:59:20.975824 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant: tempest-AttachVolumeNegativeTest-477133645 Aug 24 03:59:20.975824 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Id: 46ef5b02d8da4d2eac26b6ccfb35e1a4 Aug 24 03:59:20.975824 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-477133645 Aug 24 03:59:20.975824 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User: tempest-AttachVolumeNegativeTest-477133645-project Aug 24 03:59:20.975824 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Id: default Aug 24 03:59:20.975824 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Name: Default Aug 24 03:59:20.975824 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Id: e5582d10ebef459084fe287c18568f98 Aug 24 03:59:20.975824 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Name: tempest-AttachVolumeNegativeTest-477133645-project Aug 24 03:59:20.975824 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: method: > Aug 24 03:59:20.975824 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: exception: Instance 66dd80a8-8e33-421c-9c4a-200ad720823a could not be found. Aug 24 03:59:20.975824 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: action_args: {'id': '66dd80a8-8e33-421c-9c4a-200ad720823a'} Aug 24 03:59:20.976578 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:59:20.976578 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:20.976578 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:59:20.976578 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:59:20.976578 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:59:20.976578 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:59:20.976578 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:59:20.976578 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:59:20.976578 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:59:20.976578 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:59:20.976578 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66dd80a8-8e33-421c-9c4a-200ad720823a could not be found. Aug 24 03:59:20.976578 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:20.976578 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:20.976578 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:20.976578 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:20.976578 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:20.976578 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:20.976578 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:59:20.976578 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:59:20.976578 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:59:20.979869 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:59:20.979869 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:59:20.979869 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:59:20.979869 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:59:20.979869 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:59:20.979869 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:59:20.979869 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:59:20.979869 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66dd80a8-8e33-421c-9c4a-200ad720823a could not be found. Aug 24 03:59:20.979869 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:20.979869 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:20.979869 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:20.979869 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:20.979869 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:20.979869 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:20.979869 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:59:20.979869 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:59:20.979869 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66dd80a8-8e33-421c-9c4a-200ad720823a could not be found. Aug 24 03:59:20.979869 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:20.981016 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-a5b93ada-4674-4c72-af7e-68b88e946d1a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Returning 404 to user: Instance 66dd80a8-8e33-421c-9c4a-200ad720823a could not be found. {{(pid=127869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:59:20.981016 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-a5b93ada-4674-4c72-af7e-68b88e946d1a tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a" status: 404 len: 111 microversion: 2.1 time: 0.032142 Aug 24 03:59:20.981016 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 456/905] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:20 2022] GET /compute/v2.1/servers/66dd80a8-8e33-421c-9c4a-200ad720823a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:59:21.305136 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6621755c-3568-4e8f-aff9-b2ce96509736 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:21.305633 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6621755c-3568-4e8f-aff9-b2ce96509736 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:21.311482 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6621755c-3568-4e8f-aff9-b2ce96509736 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:21.311969 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6621755c-3568-4e8f-aff9-b2ce96509736 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:21.312401 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6621755c-3568-4e8f-aff9-b2ce96509736 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:21.313087 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6621755c-3568-4e8f-aff9-b2ce96509736 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:21.313540 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6621755c-3568-4e8f-aff9-b2ce96509736 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:21.313991 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6621755c-3568-4e8f-aff9-b2ce96509736 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:21.327247 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-6621755c-3568-4e8f-aff9-b2ce96509736 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] HTTP exception thrown: Instance 0aa2d996-08d6-46ce-b978-5de69b34a0f6 could not be found. Aug 24 03:59:21.328803 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6621755c-3568-4e8f-aff9-b2ce96509736 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Request method failure captured: Aug 24 03:59:21.328803 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 HTTP/1.1 Aug 24 03:59:21.328803 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept: application/json Aug 24 03:59:21.328803 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept-Encoding: identity Aug 24 03:59:21.328803 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Connection: close Aug 24 03:59:21.328803 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Length: 0 Aug 24 03:59:21.328803 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Type: application/json Aug 24 03:59:21.328803 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Host: 10.222.0.82 Aug 24 03:59:21.328803 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Openstack-System-Scope: None Aug 24 03:59:21.328803 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.11 Aug 24 03:59:21.328803 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Auth-Token: gAAAAABjBaB1cjCRnkMdHT63ADEXIl04mKhwJKM8oB9_h50wLjevdzc0b0dxIWZS5wG2Ps-xU1gmr2cQNGh_Jy8xgNCbrBWwOVouw_UcERGGMkxy0MkStgJZtLDlrU4C8PdZSSvTSNljq4C40rGVOwds8ysCUWQ6A06SBL2ZgzFe5zxFM_wEzTc Aug 24 03:59:21.328803 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Id: None Aug 24 03:59:21.328803 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Name: None Aug 24 03:59:21.328803 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Identity-Status: Confirmed Aug 24 03:59:21.328803 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Is-Admin-Project: True Aug 24 03:59:21.328803 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Id: default Aug 24 03:59:21.328803 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Name: Default Aug 24 03:59:21.328803 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Id: bdb802f52e1140d488ff0c6d739cd0d1 Aug 24 03:59:21.328803 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Name: tempest-AttachVolumeTestJSON-642371474 Aug 24 03:59:21.328803 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Role: member,reader Aug 24 03:59:21.328803 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Roles: member,reader Aug 24 03:59:21.331449 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/bdb802f52e1140d488ff0c6d739cd0d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/bdb802f52e1140d488ff0c6d739cd0d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/bdb802f52e1140d488ff0c6d739cd0d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_bdb802f52e1140d488ff0c6d739cd0d1", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:59:21.331449 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant: tempest-AttachVolumeTestJSON-642371474 Aug 24 03:59:21.331449 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Id: bdb802f52e1140d488ff0c6d739cd0d1 Aug 24 03:59:21.331449 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Name: tempest-AttachVolumeTestJSON-642371474 Aug 24 03:59:21.331449 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User: tempest-AttachVolumeTestJSON-642371474-project Aug 24 03:59:21.331449 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Id: default Aug 24 03:59:21.331449 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Name: Default Aug 24 03:59:21.331449 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Id: c7e29563153a4ecbbe7447bed0324df7 Aug 24 03:59:21.331449 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Name: tempest-AttachVolumeTestJSON-642371474-project Aug 24 03:59:21.331449 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: method: > Aug 24 03:59:21.331449 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: exception: Instance 0aa2d996-08d6-46ce-b978-5de69b34a0f6 could not be found. Aug 24 03:59:21.331449 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: action_args: {'id': '0aa2d996-08d6-46ce-b978-5de69b34a0f6'} Aug 24 03:59:21.332204 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:59:21.332204 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:21.332204 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:59:21.332204 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:59:21.332204 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:59:21.332204 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:59:21.332204 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:59:21.332204 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:59:21.332204 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:59:21.332204 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:59:21.332204 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0aa2d996-08d6-46ce-b978-5de69b34a0f6 could not be found. Aug 24 03:59:21.332204 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:21.332204 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:21.332204 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:21.332204 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:21.332204 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:21.332204 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:21.332204 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:59:21.332204 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:59:21.332204 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:59:21.333428 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:59:21.333428 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:59:21.333428 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:59:21.333428 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:59:21.333428 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:59:21.333428 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:59:21.333428 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:59:21.333428 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:59:21.333428 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:59:21.333428 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0aa2d996-08d6-46ce-b978-5de69b34a0f6 could not be found. Aug 24 03:59:21.333428 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:21.333428 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:21.333428 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:21.333428 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:21.333428 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:21.333428 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:21.333428 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:59:21.333428 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:59:21.333428 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0aa2d996-08d6-46ce-b978-5de69b34a0f6 could not be found. Aug 24 03:59:21.333428 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:21.334658 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6621755c-3568-4e8f-aff9-b2ce96509736 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Returning 404 to user: Instance 0aa2d996-08d6-46ce-b978-5de69b34a0f6 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:59:21.334658 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6621755c-3568-4e8f-aff9-b2ce96509736 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "DELETE /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 404 len: 111 microversion: 2.1 time: 0.029386 Aug 24 03:59:21.334658 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 450/906] 10.222.0.82 () {58 vars in 1239 bytes} [Wed Aug 24 03:59:21 2022] DELETE /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:59:21.339014 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-e188d574-4eeb-4f00-904e-3662cb651db5 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:21.339627 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-e188d574-4eeb-4f00-904e-3662cb651db5 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] [instance: 0aa2d996-08d6-46ce-b978-5de69b34a0f6] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:21.346271 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e188d574-4eeb-4f00-904e-3662cb651db5 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:21.346783 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e188d574-4eeb-4f00-904e-3662cb651db5 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:21.347210 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e188d574-4eeb-4f00-904e-3662cb651db5 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:21.347894 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e188d574-4eeb-4f00-904e-3662cb651db5 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:21.348342 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e188d574-4eeb-4f00-904e-3662cb651db5 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:21.348793 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e188d574-4eeb-4f00-904e-3662cb651db5 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:21.362160 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.wsgi [None req-e188d574-4eeb-4f00-904e-3662cb651db5 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] HTTP exception thrown: Instance 0aa2d996-08d6-46ce-b978-5de69b34a0f6 could not be found. Aug 24 03:59:21.363734 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-e188d574-4eeb-4f00-904e-3662cb651db5 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Request method failure captured: Aug 24 03:59:21.363734 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: request: GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 HTTP/1.1 Aug 24 03:59:21.363734 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept: application/json Aug 24 03:59:21.363734 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept-Encoding: identity Aug 24 03:59:21.363734 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Connection: close Aug 24 03:59:21.363734 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Length: 0 Aug 24 03:59:21.363734 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Type: application/json Aug 24 03:59:21.363734 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Host: 10.222.0.82 Aug 24 03:59:21.363734 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Openstack-System-Scope: None Aug 24 03:59:21.363734 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: User-Agent: python-urllib3/1.26.11 Aug 24 03:59:21.363734 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Auth-Token: gAAAAABjBaB1cjCRnkMdHT63ADEXIl04mKhwJKM8oB9_h50wLjevdzc0b0dxIWZS5wG2Ps-xU1gmr2cQNGh_Jy8xgNCbrBWwOVouw_UcERGGMkxy0MkStgJZtLDlrU4C8PdZSSvTSNljq4C40rGVOwds8ysCUWQ6A06SBL2ZgzFe5zxFM_wEzTc Aug 24 03:59:21.363734 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Id: None Aug 24 03:59:21.363734 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Name: None Aug 24 03:59:21.363734 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Identity-Status: Confirmed Aug 24 03:59:21.363734 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Is-Admin-Project: True Aug 24 03:59:21.363734 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Id: default Aug 24 03:59:21.363734 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Name: Default Aug 24 03:59:21.363734 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Id: bdb802f52e1140d488ff0c6d739cd0d1 Aug 24 03:59:21.363734 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Name: tempest-AttachVolumeTestJSON-642371474 Aug 24 03:59:21.363734 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Role: member,reader Aug 24 03:59:21.363734 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Roles: member,reader Aug 24 03:59:21.365307 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/bdb802f52e1140d488ff0c6d739cd0d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/bdb802f52e1140d488ff0c6d739cd0d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/bdb802f52e1140d488ff0c6d739cd0d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_bdb802f52e1140d488ff0c6d739cd0d1", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:59:21.365307 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant: tempest-AttachVolumeTestJSON-642371474 Aug 24 03:59:21.365307 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Id: bdb802f52e1140d488ff0c6d739cd0d1 Aug 24 03:59:21.365307 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Name: tempest-AttachVolumeTestJSON-642371474 Aug 24 03:59:21.365307 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User: tempest-AttachVolumeTestJSON-642371474-project Aug 24 03:59:21.365307 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Id: default Aug 24 03:59:21.365307 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Name: Default Aug 24 03:59:21.365307 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Id: c7e29563153a4ecbbe7447bed0324df7 Aug 24 03:59:21.365307 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Name: tempest-AttachVolumeTestJSON-642371474-project Aug 24 03:59:21.365307 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: method: > Aug 24 03:59:21.365307 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: exception: Instance 0aa2d996-08d6-46ce-b978-5de69b34a0f6 could not be found. Aug 24 03:59:21.365307 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: action_args: {'id': '0aa2d996-08d6-46ce-b978-5de69b34a0f6'} Aug 24 03:59:21.366378 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:59:21.366378 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:21.366378 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:59:21.366378 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:59:21.366378 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:59:21.366378 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:59:21.366378 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:59:21.366378 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:59:21.366378 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:59:21.366378 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:59:21.366378 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0aa2d996-08d6-46ce-b978-5de69b34a0f6 could not be found. Aug 24 03:59:21.366378 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:21.366378 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:21.366378 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:21.366378 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:21.366378 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:21.366378 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:21.366378 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:59:21.366378 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:59:21.366378 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:59:21.367918 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:59:21.367918 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:59:21.367918 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:59:21.367918 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:59:21.367918 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:59:21.367918 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:59:21.367918 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:59:21.367918 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0aa2d996-08d6-46ce-b978-5de69b34a0f6 could not be found. Aug 24 03:59:21.367918 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:21.367918 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:21.367918 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:21.367918 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:21.367918 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:21.367918 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:21.367918 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:59:21.367918 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:59:21.367918 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0aa2d996-08d6-46ce-b978-5de69b34a0f6 could not be found. Aug 24 03:59:21.367918 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:21.369353 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-e188d574-4eeb-4f00-904e-3662cb651db5 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] Returning 404 to user: Instance 0aa2d996-08d6-46ce-b978-5de69b34a0f6 could not be found. {{(pid=127869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:59:21.369353 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-e188d574-4eeb-4f00-904e-3662cb651db5 tempest-AttachVolumeTestJSON-642371474 tempest-AttachVolumeTestJSON-642371474-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6" status: 404 len: 111 microversion: 2.1 time: 0.029889 Aug 24 03:59:21.369353 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 457/907] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:21 2022] GET /compute/v2.1/servers/0aa2d996-08d6-46ce-b978-5de69b34a0f6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:59:22.236692 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bf0c89fb-d9ed-499f-a4d6-5bb40ddfd6e6 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:22.237281 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bf0c89fb-d9ed-499f-a4d6-5bb40ddfd6e6 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 0109332f-80ab-4d03-ba4d-1a24fc88fcf1] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:22.244059 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf0c89fb-d9ed-499f-a4d6-5bb40ddfd6e6 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:22.244541 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf0c89fb-d9ed-499f-a4d6-5bb40ddfd6e6 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:22.244980 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf0c89fb-d9ed-499f-a4d6-5bb40ddfd6e6 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:22.245687 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf0c89fb-d9ed-499f-a4d6-5bb40ddfd6e6 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:22.246155 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf0c89fb-d9ed-499f-a4d6-5bb40ddfd6e6 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:22.246613 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf0c89fb-d9ed-499f-a4d6-5bb40ddfd6e6 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:22.261637 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-bf0c89fb-d9ed-499f-a4d6-5bb40ddfd6e6 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] HTTP exception thrown: Instance 0109332f-80ab-4d03-ba4d-1a24fc88fcf1 could not be found. Aug 24 03:59:22.263307 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bf0c89fb-d9ed-499f-a4d6-5bb40ddfd6e6 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Request method failure captured: Aug 24 03:59:22.263307 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1 HTTP/1.1 Aug 24 03:59:22.263307 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept: application/json Aug 24 03:59:22.263307 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept-Encoding: identity Aug 24 03:59:22.263307 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Connection: close Aug 24 03:59:22.263307 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Length: 0 Aug 24 03:59:22.263307 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Type: application/json Aug 24 03:59:22.263307 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Host: 10.222.0.82 Aug 24 03:59:22.263307 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Openstack-System-Scope: None Aug 24 03:59:22.263307 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.11 Aug 24 03:59:22.263307 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Auth-Token: gAAAAABjBaByYUQ7dP595ip40_OJ_0ufC71Rc-FPYS4vZXmmx4Fislhg9iz6FfvLLHiwJ4Ed0bFNDX6fhqS1zmk_A3EKqVLHT9Pz2gZaaIcE0OalzJoOw2sqfwO-7iDYasbxHIEhvzvTJNavoRaspbu_b6_R5EZ70Pa8SKRgBtFA8vqfpAdszSk Aug 24 03:59:22.263307 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Id: None Aug 24 03:59:22.263307 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Name: None Aug 24 03:59:22.263307 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Identity-Status: Confirmed Aug 24 03:59:22.263307 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Is-Admin-Project: True Aug 24 03:59:22.263307 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Id: default Aug 24 03:59:22.263307 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Name: Default Aug 24 03:59:22.263307 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Id: 46ef5b02d8da4d2eac26b6ccfb35e1a4 Aug 24 03:59:22.263307 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Name: tempest-AttachVolumeNegativeTest-477133645 Aug 24 03:59:22.263307 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Role: member,reader Aug 24 03:59:22.263307 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Roles: member,reader Aug 24 03:59:22.264675 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/46ef5b02d8da4d2eac26b6ccfb35e1a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/46ef5b02d8da4d2eac26b6ccfb35e1a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/46ef5b02d8da4d2eac26b6ccfb35e1a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_46ef5b02d8da4d2eac26b6ccfb35e1a4", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:59:22.264675 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant: tempest-AttachVolumeNegativeTest-477133645 Aug 24 03:59:22.264675 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Id: 46ef5b02d8da4d2eac26b6ccfb35e1a4 Aug 24 03:59:22.264675 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-477133645 Aug 24 03:59:22.264675 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User: tempest-AttachVolumeNegativeTest-477133645-project Aug 24 03:59:22.264675 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Id: default Aug 24 03:59:22.264675 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Name: Default Aug 24 03:59:22.264675 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Id: e5582d10ebef459084fe287c18568f98 Aug 24 03:59:22.264675 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Name: tempest-AttachVolumeNegativeTest-477133645-project Aug 24 03:59:22.264675 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: method: > Aug 24 03:59:22.264675 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: exception: Instance 0109332f-80ab-4d03-ba4d-1a24fc88fcf1 could not be found. Aug 24 03:59:22.264675 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: action_args: {'id': '0109332f-80ab-4d03-ba4d-1a24fc88fcf1'} Aug 24 03:59:22.265433 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:59:22.265433 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:22.265433 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:59:22.265433 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:59:22.265433 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:59:22.265433 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:59:22.265433 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:59:22.265433 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:59:22.265433 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:59:22.265433 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:59:22.265433 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0109332f-80ab-4d03-ba4d-1a24fc88fcf1 could not be found. Aug 24 03:59:22.265433 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:22.265433 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:22.265433 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:22.265433 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:22.265433 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:22.265433 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:22.265433 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:59:22.265433 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:59:22.265433 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:59:22.269755 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:59:22.269755 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:59:22.269755 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:59:22.269755 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:59:22.269755 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:59:22.269755 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:59:22.269755 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:59:22.269755 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:59:22.269755 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:59:22.269755 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0109332f-80ab-4d03-ba4d-1a24fc88fcf1 could not be found. Aug 24 03:59:22.269755 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:22.269755 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:22.269755 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:22.269755 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:22.269755 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:22.269755 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:22.269755 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:59:22.269755 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:59:22.269755 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0109332f-80ab-4d03-ba4d-1a24fc88fcf1 could not be found. Aug 24 03:59:22.269755 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:22.271493 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bf0c89fb-d9ed-499f-a4d6-5bb40ddfd6e6 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Returning 404 to user: Instance 0109332f-80ab-4d03-ba4d-1a24fc88fcf1 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:59:22.271493 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bf0c89fb-d9ed-499f-a4d6-5bb40ddfd6e6 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "DELETE /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1" status: 404 len: 111 microversion: 2.1 time: 0.032456 Aug 24 03:59:22.271493 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 451/908] 10.222.0.82 () {58 vars in 1239 bytes} [Wed Aug 24 03:59:22 2022] DELETE /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:59:22.276176 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-ed9331ab-098a-4d74-9545-df8d0fd0ac79 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:22.276802 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-ed9331ab-098a-4d74-9545-df8d0fd0ac79 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: 0109332f-80ab-4d03-ba4d-1a24fc88fcf1] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:22.283235 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ed9331ab-098a-4d74-9545-df8d0fd0ac79 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:22.283787 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ed9331ab-098a-4d74-9545-df8d0fd0ac79 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:22.284212 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ed9331ab-098a-4d74-9545-df8d0fd0ac79 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:22.284883 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ed9331ab-098a-4d74-9545-df8d0fd0ac79 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:22.285317 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ed9331ab-098a-4d74-9545-df8d0fd0ac79 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:22.285729 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ed9331ab-098a-4d74-9545-df8d0fd0ac79 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:22.301129 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.wsgi [None req-ed9331ab-098a-4d74-9545-df8d0fd0ac79 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] HTTP exception thrown: Instance 0109332f-80ab-4d03-ba4d-1a24fc88fcf1 could not be found. Aug 24 03:59:22.311458 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-ed9331ab-098a-4d74-9545-df8d0fd0ac79 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Request method failure captured: Aug 24 03:59:22.311458 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: request: GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1 HTTP/1.1 Aug 24 03:59:22.311458 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept: application/json Aug 24 03:59:22.311458 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept-Encoding: identity Aug 24 03:59:22.311458 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Connection: close Aug 24 03:59:22.311458 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Length: 0 Aug 24 03:59:22.311458 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Type: application/json Aug 24 03:59:22.311458 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Host: 10.222.0.82 Aug 24 03:59:22.311458 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Openstack-System-Scope: None Aug 24 03:59:22.311458 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: User-Agent: python-urllib3/1.26.11 Aug 24 03:59:22.311458 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Auth-Token: gAAAAABjBaByYUQ7dP595ip40_OJ_0ufC71Rc-FPYS4vZXmmx4Fislhg9iz6FfvLLHiwJ4Ed0bFNDX6fhqS1zmk_A3EKqVLHT9Pz2gZaaIcE0OalzJoOw2sqfwO-7iDYasbxHIEhvzvTJNavoRaspbu_b6_R5EZ70Pa8SKRgBtFA8vqfpAdszSk Aug 24 03:59:22.311458 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Id: None Aug 24 03:59:22.311458 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Name: None Aug 24 03:59:22.311458 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Identity-Status: Confirmed Aug 24 03:59:22.311458 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Is-Admin-Project: True Aug 24 03:59:22.311458 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Id: default Aug 24 03:59:22.311458 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Name: Default Aug 24 03:59:22.311458 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Id: 46ef5b02d8da4d2eac26b6ccfb35e1a4 Aug 24 03:59:22.311458 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Name: tempest-AttachVolumeNegativeTest-477133645 Aug 24 03:59:22.311458 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Role: member,reader Aug 24 03:59:22.311458 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Roles: member,reader Aug 24 03:59:22.313029 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/46ef5b02d8da4d2eac26b6ccfb35e1a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/46ef5b02d8da4d2eac26b6ccfb35e1a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/46ef5b02d8da4d2eac26b6ccfb35e1a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_46ef5b02d8da4d2eac26b6ccfb35e1a4", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:59:22.313029 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant: tempest-AttachVolumeNegativeTest-477133645 Aug 24 03:59:22.313029 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Id: 46ef5b02d8da4d2eac26b6ccfb35e1a4 Aug 24 03:59:22.313029 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-477133645 Aug 24 03:59:22.313029 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User: tempest-AttachVolumeNegativeTest-477133645-project Aug 24 03:59:22.313029 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Id: default Aug 24 03:59:22.313029 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Name: Default Aug 24 03:59:22.313029 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Id: e5582d10ebef459084fe287c18568f98 Aug 24 03:59:22.313029 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Name: tempest-AttachVolumeNegativeTest-477133645-project Aug 24 03:59:22.313029 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: method: > Aug 24 03:59:22.313029 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: exception: Instance 0109332f-80ab-4d03-ba4d-1a24fc88fcf1 could not be found. Aug 24 03:59:22.313029 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: action_args: {'id': '0109332f-80ab-4d03-ba4d-1a24fc88fcf1'} Aug 24 03:59:22.314943 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:59:22.314943 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:22.314943 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:59:22.314943 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:59:22.314943 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:59:22.314943 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:59:22.314943 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:59:22.314943 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:59:22.314943 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:59:22.314943 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:59:22.314943 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0109332f-80ab-4d03-ba4d-1a24fc88fcf1 could not be found. Aug 24 03:59:22.314943 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:22.314943 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:22.314943 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:22.314943 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:22.314943 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:22.314943 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:22.314943 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:59:22.314943 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:59:22.314943 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:59:22.316460 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:59:22.316460 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:59:22.316460 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:59:22.316460 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:59:22.316460 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:59:22.316460 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:59:22.316460 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:59:22.316460 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0109332f-80ab-4d03-ba4d-1a24fc88fcf1 could not be found. Aug 24 03:59:22.316460 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:22.316460 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:22.316460 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:22.316460 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:22.316460 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:22.316460 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:22.316460 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:59:22.316460 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:59:22.316460 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0109332f-80ab-4d03-ba4d-1a24fc88fcf1 could not be found. Aug 24 03:59:22.316460 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:22.317898 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-ed9331ab-098a-4d74-9545-df8d0fd0ac79 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Returning 404 to user: Instance 0109332f-80ab-4d03-ba4d-1a24fc88fcf1 could not be found. {{(pid=127869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:59:22.317898 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-ed9331ab-098a-4d74-9545-df8d0fd0ac79 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1" status: 404 len: 111 microversion: 2.1 time: 0.031676 Aug 24 03:59:22.317898 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 458/909] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:22 2022] GET /compute/v2.1/servers/0109332f-80ab-4d03-ba4d-1a24fc88fcf1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:59:22.319244 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5a9cad86-8067-4970-8a02-51e53ed37e29 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:22.319743 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5a9cad86-8067-4970-8a02-51e53ed37e29 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: b7890971-d4d3-4a0e-bc58-b428eb8c5f0e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:22.326089 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5a9cad86-8067-4970-8a02-51e53ed37e29 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:22.326604 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5a9cad86-8067-4970-8a02-51e53ed37e29 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:22.327344 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5a9cad86-8067-4970-8a02-51e53ed37e29 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:22.328035 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5a9cad86-8067-4970-8a02-51e53ed37e29 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:22.328488 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5a9cad86-8067-4970-8a02-51e53ed37e29 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:22.328912 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5a9cad86-8067-4970-8a02-51e53ed37e29 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:22.333552 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:22.343038 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-5a9cad86-8067-4970-8a02-51e53ed37e29 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] HTTP exception thrown: Instance b7890971-d4d3-4a0e-bc58-b428eb8c5f0e could not be found. Aug 24 03:59:22.344602 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5a9cad86-8067-4970-8a02-51e53ed37e29 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Request method failure captured: Aug 24 03:59:22.344602 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e HTTP/1.1 Aug 24 03:59:22.344602 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept: application/json Aug 24 03:59:22.344602 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept-Encoding: identity Aug 24 03:59:22.344602 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Connection: close Aug 24 03:59:22.344602 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Length: 0 Aug 24 03:59:22.344602 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Type: application/json Aug 24 03:59:22.344602 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Host: 10.222.0.82 Aug 24 03:59:22.344602 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Openstack-System-Scope: None Aug 24 03:59:22.344602 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.11 Aug 24 03:59:22.344602 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Auth-Token: gAAAAABjBaByYUQ7dP595ip40_OJ_0ufC71Rc-FPYS4vZXmmx4Fislhg9iz6FfvLLHiwJ4Ed0bFNDX6fhqS1zmk_A3EKqVLHT9Pz2gZaaIcE0OalzJoOw2sqfwO-7iDYasbxHIEhvzvTJNavoRaspbu_b6_R5EZ70Pa8SKRgBtFA8vqfpAdszSk Aug 24 03:59:22.344602 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Id: None Aug 24 03:59:22.344602 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Name: None Aug 24 03:59:22.344602 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Identity-Status: Confirmed Aug 24 03:59:22.344602 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Is-Admin-Project: True Aug 24 03:59:22.344602 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Id: default Aug 24 03:59:22.344602 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Name: Default Aug 24 03:59:22.344602 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Id: 46ef5b02d8da4d2eac26b6ccfb35e1a4 Aug 24 03:59:22.344602 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Name: tempest-AttachVolumeNegativeTest-477133645 Aug 24 03:59:22.344602 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Role: member,reader Aug 24 03:59:22.344602 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Roles: member,reader Aug 24 03:59:22.346970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/46ef5b02d8da4d2eac26b6ccfb35e1a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/46ef5b02d8da4d2eac26b6ccfb35e1a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/46ef5b02d8da4d2eac26b6ccfb35e1a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_46ef5b02d8da4d2eac26b6ccfb35e1a4", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:59:22.346970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant: tempest-AttachVolumeNegativeTest-477133645 Aug 24 03:59:22.346970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Id: 46ef5b02d8da4d2eac26b6ccfb35e1a4 Aug 24 03:59:22.346970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-477133645 Aug 24 03:59:22.346970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User: tempest-AttachVolumeNegativeTest-477133645-project Aug 24 03:59:22.346970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Id: default Aug 24 03:59:22.346970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Name: Default Aug 24 03:59:22.346970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Id: e5582d10ebef459084fe287c18568f98 Aug 24 03:59:22.346970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Name: tempest-AttachVolumeNegativeTest-477133645-project Aug 24 03:59:22.346970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: method: > Aug 24 03:59:22.346970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: exception: Instance b7890971-d4d3-4a0e-bc58-b428eb8c5f0e could not be found. Aug 24 03:59:22.346970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: action_args: {'id': 'b7890971-d4d3-4a0e-bc58-b428eb8c5f0e'} Aug 24 03:59:22.348201 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:59:22.348201 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:22.348201 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:59:22.348201 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:59:22.348201 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:59:22.348201 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:59:22.348201 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:59:22.348201 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:59:22.348201 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:59:22.348201 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:59:22.348201 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7890971-d4d3-4a0e-bc58-b428eb8c5f0e could not be found. Aug 24 03:59:22.348201 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:22.348201 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:22.348201 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:22.348201 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:22.348201 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:22.348201 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:22.348201 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:59:22.348201 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:59:22.348201 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:59:22.349662 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:59:22.349662 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:59:22.349662 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:59:22.349662 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:59:22.349662 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:59:22.349662 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:59:22.349662 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:59:22.349662 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:59:22.349662 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:59:22.349662 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7890971-d4d3-4a0e-bc58-b428eb8c5f0e could not be found. Aug 24 03:59:22.349662 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:22.349662 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:22.349662 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:22.349662 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:22.349662 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:22.349662 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:22.349662 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:59:22.349662 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:59:22.349662 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7890971-d4d3-4a0e-bc58-b428eb8c5f0e could not be found. Aug 24 03:59:22.349662 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:22.351159 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5a9cad86-8067-4970-8a02-51e53ed37e29 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Returning 404 to user: Instance b7890971-d4d3-4a0e-bc58-b428eb8c5f0e could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:59:22.351159 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5a9cad86-8067-4970-8a02-51e53ed37e29 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "DELETE /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e" status: 404 len: 111 microversion: 2.1 time: 0.030768 Aug 24 03:59:22.351159 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 452/910] 10.222.0.82 () {58 vars in 1239 bytes} [Wed Aug 24 03:59:22 2022] DELETE /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:59:22.354650 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-53cb6804-c7ed-4171-a32a-a42fc13d1112 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:22.361213 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-53cb6804-c7ed-4171-a32a-a42fc13d1112 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: b7890971-d4d3-4a0e-bc58-b428eb8c5f0e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:22.362230 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-53cb6804-c7ed-4171-a32a-a42fc13d1112 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:22.362745 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-53cb6804-c7ed-4171-a32a-a42fc13d1112 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:22.363185 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-53cb6804-c7ed-4171-a32a-a42fc13d1112 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:22.364008 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-53cb6804-c7ed-4171-a32a-a42fc13d1112 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:22.364327 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-53cb6804-c7ed-4171-a32a-a42fc13d1112 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:22.364746 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-53cb6804-c7ed-4171-a32a-a42fc13d1112 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:22.380236 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.wsgi [None req-53cb6804-c7ed-4171-a32a-a42fc13d1112 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] HTTP exception thrown: Instance b7890971-d4d3-4a0e-bc58-b428eb8c5f0e could not be found. Aug 24 03:59:22.381777 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-53cb6804-c7ed-4171-a32a-a42fc13d1112 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Request method failure captured: Aug 24 03:59:22.381777 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: request: GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e HTTP/1.1 Aug 24 03:59:22.381777 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept: application/json Aug 24 03:59:22.381777 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept-Encoding: identity Aug 24 03:59:22.381777 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Connection: close Aug 24 03:59:22.381777 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Length: 0 Aug 24 03:59:22.381777 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Type: application/json Aug 24 03:59:22.381777 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Host: 10.222.0.82 Aug 24 03:59:22.381777 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Openstack-System-Scope: None Aug 24 03:59:22.381777 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: User-Agent: python-urllib3/1.26.11 Aug 24 03:59:22.381777 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Auth-Token: gAAAAABjBaByYUQ7dP595ip40_OJ_0ufC71Rc-FPYS4vZXmmx4Fislhg9iz6FfvLLHiwJ4Ed0bFNDX6fhqS1zmk_A3EKqVLHT9Pz2gZaaIcE0OalzJoOw2sqfwO-7iDYasbxHIEhvzvTJNavoRaspbu_b6_R5EZ70Pa8SKRgBtFA8vqfpAdszSk Aug 24 03:59:22.381777 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Id: None Aug 24 03:59:22.381777 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Name: None Aug 24 03:59:22.381777 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Identity-Status: Confirmed Aug 24 03:59:22.381777 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Is-Admin-Project: True Aug 24 03:59:22.381777 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Id: default Aug 24 03:59:22.381777 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Name: Default Aug 24 03:59:22.381777 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Id: 46ef5b02d8da4d2eac26b6ccfb35e1a4 Aug 24 03:59:22.381777 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Name: tempest-AttachVolumeNegativeTest-477133645 Aug 24 03:59:22.381777 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Role: member,reader Aug 24 03:59:22.381777 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Roles: member,reader Aug 24 03:59:22.383250 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/46ef5b02d8da4d2eac26b6ccfb35e1a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/46ef5b02d8da4d2eac26b6ccfb35e1a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/46ef5b02d8da4d2eac26b6ccfb35e1a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_46ef5b02d8da4d2eac26b6ccfb35e1a4", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:59:22.383250 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant: tempest-AttachVolumeNegativeTest-477133645 Aug 24 03:59:22.383250 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Id: 46ef5b02d8da4d2eac26b6ccfb35e1a4 Aug 24 03:59:22.383250 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-477133645 Aug 24 03:59:22.383250 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User: tempest-AttachVolumeNegativeTest-477133645-project Aug 24 03:59:22.383250 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Id: default Aug 24 03:59:22.383250 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Name: Default Aug 24 03:59:22.383250 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Id: e5582d10ebef459084fe287c18568f98 Aug 24 03:59:22.383250 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Name: tempest-AttachVolumeNegativeTest-477133645-project Aug 24 03:59:22.383250 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: method: > Aug 24 03:59:22.383250 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: exception: Instance b7890971-d4d3-4a0e-bc58-b428eb8c5f0e could not be found. Aug 24 03:59:22.383250 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: action_args: {'id': 'b7890971-d4d3-4a0e-bc58-b428eb8c5f0e'} Aug 24 03:59:22.386136 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:59:22.386136 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:22.386136 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:59:22.386136 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:59:22.386136 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:59:22.386136 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:59:22.386136 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:59:22.386136 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:59:22.386136 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:59:22.386136 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:59:22.386136 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7890971-d4d3-4a0e-bc58-b428eb8c5f0e could not be found. Aug 24 03:59:22.386136 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:22.386136 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:22.386136 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:22.386136 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:22.386136 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:22.386136 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:22.386136 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:59:22.386136 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:59:22.386136 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:59:22.395401 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:59:22.395401 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:59:22.395401 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:59:22.395401 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:59:22.395401 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:59:22.395401 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:59:22.395401 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:59:22.395401 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7890971-d4d3-4a0e-bc58-b428eb8c5f0e could not be found. Aug 24 03:59:22.395401 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:22.395401 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:22.395401 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:22.395401 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:22.395401 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:22.395401 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:22.395401 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:59:22.395401 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:59:22.395401 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7890971-d4d3-4a0e-bc58-b428eb8c5f0e could not be found. Aug 24 03:59:22.395401 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:22.396747 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-53cb6804-c7ed-4171-a32a-a42fc13d1112 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Returning 404 to user: Instance b7890971-d4d3-4a0e-bc58-b428eb8c5f0e could not be found. {{(pid=127869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:59:22.396747 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-53cb6804-c7ed-4171-a32a-a42fc13d1112 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e" status: 404 len: 111 microversion: 2.1 time: 0.032415 Aug 24 03:59:22.396747 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 459/911] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:22 2022] GET /compute/v2.1/servers/b7890971-d4d3-4a0e-bc58-b428eb8c5f0e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:59:23.764691 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7911edc8-359b-4cab-ad26-0639be509c87 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:23.767438 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7911edc8-359b-4cab-ad26-0639be509c87 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:23.774366 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7911edc8-359b-4cab-ad26-0639be509c87 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:23.775076 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7911edc8-359b-4cab-ad26-0639be509c87 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:23.775515 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7911edc8-359b-4cab-ad26-0639be509c87 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:23.776234 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7911edc8-359b-4cab-ad26-0639be509c87 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:23.776697 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7911edc8-359b-4cab-ad26-0639be509c87 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:23.777129 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7911edc8-359b-4cab-ad26-0639be509c87 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:23.793324 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-7911edc8-359b-4cab-ad26-0639be509c87 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] HTTP exception thrown: Instance dd0bdd49-e4b5-4819-91f5-399d77f4dd4b could not be found. Aug 24 03:59:23.794957 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7911edc8-359b-4cab-ad26-0639be509c87 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Request method failure captured: Aug 24 03:59:23.794957 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b HTTP/1.1 Aug 24 03:59:23.794957 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept: application/json Aug 24 03:59:23.794957 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept-Encoding: identity Aug 24 03:59:23.794957 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Connection: close Aug 24 03:59:23.794957 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Length: 0 Aug 24 03:59:23.794957 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Type: application/json Aug 24 03:59:23.794957 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Host: 10.222.0.82 Aug 24 03:59:23.794957 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Openstack-System-Scope: None Aug 24 03:59:23.794957 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.11 Aug 24 03:59:23.794957 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Auth-Token: gAAAAABjBaByYUQ7dP595ip40_OJ_0ufC71Rc-FPYS4vZXmmx4Fislhg9iz6FfvLLHiwJ4Ed0bFNDX6fhqS1zmk_A3EKqVLHT9Pz2gZaaIcE0OalzJoOw2sqfwO-7iDYasbxHIEhvzvTJNavoRaspbu_b6_R5EZ70Pa8SKRgBtFA8vqfpAdszSk Aug 24 03:59:23.794957 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Id: None Aug 24 03:59:23.794957 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Name: None Aug 24 03:59:23.794957 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Identity-Status: Confirmed Aug 24 03:59:23.794957 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Is-Admin-Project: True Aug 24 03:59:23.794957 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Id: default Aug 24 03:59:23.794957 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Name: Default Aug 24 03:59:23.794957 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Id: 46ef5b02d8da4d2eac26b6ccfb35e1a4 Aug 24 03:59:23.794957 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Name: tempest-AttachVolumeNegativeTest-477133645 Aug 24 03:59:23.794957 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Role: member,reader Aug 24 03:59:23.794957 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Roles: member,reader Aug 24 03:59:23.796350 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/46ef5b02d8da4d2eac26b6ccfb35e1a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/46ef5b02d8da4d2eac26b6ccfb35e1a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/46ef5b02d8da4d2eac26b6ccfb35e1a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_46ef5b02d8da4d2eac26b6ccfb35e1a4", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:59:23.796350 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant: tempest-AttachVolumeNegativeTest-477133645 Aug 24 03:59:23.796350 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Id: 46ef5b02d8da4d2eac26b6ccfb35e1a4 Aug 24 03:59:23.796350 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-477133645 Aug 24 03:59:23.796350 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User: tempest-AttachVolumeNegativeTest-477133645-project Aug 24 03:59:23.796350 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Id: default Aug 24 03:59:23.796350 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Name: Default Aug 24 03:59:23.796350 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Id: e5582d10ebef459084fe287c18568f98 Aug 24 03:59:23.796350 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Name: tempest-AttachVolumeNegativeTest-477133645-project Aug 24 03:59:23.796350 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: method: > Aug 24 03:59:23.796350 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: exception: Instance dd0bdd49-e4b5-4819-91f5-399d77f4dd4b could not be found. Aug 24 03:59:23.796350 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: action_args: {'id': 'dd0bdd49-e4b5-4819-91f5-399d77f4dd4b'} Aug 24 03:59:23.807489 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:59:23.807489 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:23.807489 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:59:23.807489 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:59:23.807489 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:59:23.807489 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:59:23.807489 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:59:23.807489 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:59:23.807489 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:59:23.807489 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:59:23.807489 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd0bdd49-e4b5-4819-91f5-399d77f4dd4b could not be found. Aug 24 03:59:23.807489 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:23.807489 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:23.807489 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:23.807489 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:23.807489 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:23.807489 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:23.807489 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:59:23.807489 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:59:23.807489 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:59:23.810143 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:59:23.810143 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:59:23.810143 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:59:23.810143 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:59:23.810143 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:59:23.810143 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:59:23.810143 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:59:23.810143 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:59:23.810143 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:59:23.810143 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd0bdd49-e4b5-4819-91f5-399d77f4dd4b could not be found. Aug 24 03:59:23.810143 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:23.810143 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:23.810143 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:23.810143 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:23.810143 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:23.810143 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:23.810143 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:59:23.810143 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:59:23.810143 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd0bdd49-e4b5-4819-91f5-399d77f4dd4b could not be found. Aug 24 03:59:23.810143 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:23.812552 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7911edc8-359b-4cab-ad26-0639be509c87 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Returning 404 to user: Instance dd0bdd49-e4b5-4819-91f5-399d77f4dd4b could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:59:23.812552 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7911edc8-359b-4cab-ad26-0639be509c87 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "DELETE /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b" status: 404 len: 111 microversion: 2.1 time: 0.035579 Aug 24 03:59:23.812552 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 453/912] 10.222.0.82 () {58 vars in 1239 bytes} [Wed Aug 24 03:59:23 2022] DELETE /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:59:23.812937 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-0e16f063-0730-427e-baac-4850dbe1fc16 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:23.812937 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-0e16f063-0730-427e-baac-4850dbe1fc16 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] [instance: dd0bdd49-e4b5-4819-91f5-399d77f4dd4b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:23.815655 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0e16f063-0730-427e-baac-4850dbe1fc16 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:23.816228 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0e16f063-0730-427e-baac-4850dbe1fc16 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:23.816675 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0e16f063-0730-427e-baac-4850dbe1fc16 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:23.817384 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0e16f063-0730-427e-baac-4850dbe1fc16 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:23.817843 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0e16f063-0730-427e-baac-4850dbe1fc16 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:23.818260 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0e16f063-0730-427e-baac-4850dbe1fc16 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:23.834488 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.wsgi [None req-0e16f063-0730-427e-baac-4850dbe1fc16 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] HTTP exception thrown: Instance dd0bdd49-e4b5-4819-91f5-399d77f4dd4b could not be found. Aug 24 03:59:23.836183 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-0e16f063-0730-427e-baac-4850dbe1fc16 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Request method failure captured: Aug 24 03:59:23.836183 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: request: GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b HTTP/1.1 Aug 24 03:59:23.836183 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept: application/json Aug 24 03:59:23.836183 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept-Encoding: identity Aug 24 03:59:23.836183 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Connection: close Aug 24 03:59:23.836183 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Length: 0 Aug 24 03:59:23.836183 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Type: application/json Aug 24 03:59:23.836183 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Host: 10.222.0.82 Aug 24 03:59:23.836183 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Openstack-System-Scope: None Aug 24 03:59:23.836183 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: User-Agent: python-urllib3/1.26.11 Aug 24 03:59:23.836183 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Auth-Token: gAAAAABjBaByYUQ7dP595ip40_OJ_0ufC71Rc-FPYS4vZXmmx4Fislhg9iz6FfvLLHiwJ4Ed0bFNDX6fhqS1zmk_A3EKqVLHT9Pz2gZaaIcE0OalzJoOw2sqfwO-7iDYasbxHIEhvzvTJNavoRaspbu_b6_R5EZ70Pa8SKRgBtFA8vqfpAdszSk Aug 24 03:59:23.836183 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Id: None Aug 24 03:59:23.836183 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Name: None Aug 24 03:59:23.836183 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Identity-Status: Confirmed Aug 24 03:59:23.836183 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Is-Admin-Project: True Aug 24 03:59:23.836183 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Id: default Aug 24 03:59:23.836183 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Name: Default Aug 24 03:59:23.836183 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Id: 46ef5b02d8da4d2eac26b6ccfb35e1a4 Aug 24 03:59:23.836183 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Name: tempest-AttachVolumeNegativeTest-477133645 Aug 24 03:59:23.836183 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Role: member,reader Aug 24 03:59:23.836183 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Roles: member,reader Aug 24 03:59:23.837619 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/46ef5b02d8da4d2eac26b6ccfb35e1a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/46ef5b02d8da4d2eac26b6ccfb35e1a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/46ef5b02d8da4d2eac26b6ccfb35e1a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_46ef5b02d8da4d2eac26b6ccfb35e1a4", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:59:23.837619 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant: tempest-AttachVolumeNegativeTest-477133645 Aug 24 03:59:23.837619 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Id: 46ef5b02d8da4d2eac26b6ccfb35e1a4 Aug 24 03:59:23.837619 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-477133645 Aug 24 03:59:23.837619 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User: tempest-AttachVolumeNegativeTest-477133645-project Aug 24 03:59:23.837619 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Id: default Aug 24 03:59:23.837619 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Name: Default Aug 24 03:59:23.837619 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Id: e5582d10ebef459084fe287c18568f98 Aug 24 03:59:23.837619 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Name: tempest-AttachVolumeNegativeTest-477133645-project Aug 24 03:59:23.837619 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: method: > Aug 24 03:59:23.837619 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: exception: Instance dd0bdd49-e4b5-4819-91f5-399d77f4dd4b could not be found. Aug 24 03:59:23.837619 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: action_args: {'id': 'dd0bdd49-e4b5-4819-91f5-399d77f4dd4b'} Aug 24 03:59:23.838579 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:59:23.838579 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:23.838579 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:59:23.838579 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:59:23.838579 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:59:23.838579 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:59:23.838579 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:59:23.838579 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:59:23.838579 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:59:23.838579 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:59:23.838579 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd0bdd49-e4b5-4819-91f5-399d77f4dd4b could not be found. Aug 24 03:59:23.838579 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:23.838579 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:23.838579 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:23.838579 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:23.838579 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:23.838579 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:23.838579 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:59:23.838579 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:59:23.838579 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:59:23.839854 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:59:23.839854 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:59:23.839854 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:59:23.839854 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:59:23.839854 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:59:23.839854 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:59:23.839854 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:59:23.839854 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd0bdd49-e4b5-4819-91f5-399d77f4dd4b could not be found. Aug 24 03:59:23.839854 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:23.839854 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:23.839854 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:23.839854 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:23.839854 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:23.839854 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:23.839854 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:59:23.839854 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:59:23.839854 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd0bdd49-e4b5-4819-91f5-399d77f4dd4b could not be found. Aug 24 03:59:23.839854 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:23.842126 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-0e16f063-0730-427e-baac-4850dbe1fc16 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] Returning 404 to user: Instance dd0bdd49-e4b5-4819-91f5-399d77f4dd4b could not be found. {{(pid=127869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:59:23.843196 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-0e16f063-0730-427e-baac-4850dbe1fc16 tempest-AttachVolumeNegativeTest-477133645 tempest-AttachVolumeNegativeTest-477133645-project] 10.222.0.82 "GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b" status: 404 len: 111 microversion: 2.1 time: 0.041934 Aug 24 03:59:23.848236 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 460/913] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:23 2022] GET /compute/v2.1/servers/dd0bdd49-e4b5-4819-91f5-399d77f4dd4b => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:59:36.473104 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d15d9b6e-771a-4139-a57a-937a8b5e13c3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:36.475489 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d15d9b6e-771a-4139-a57a-937a8b5e13c3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:36.478034 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=13 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:36.483160 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d15d9b6e-771a-4139-a57a-937a8b5e13c3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:36.483657 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d15d9b6e-771a-4139-a57a-937a8b5e13c3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:36.484102 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d15d9b6e-771a-4139-a57a-937a8b5e13c3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:36.484834 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d15d9b6e-771a-4139-a57a-937a8b5e13c3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:36.485295 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d15d9b6e-771a-4139-a57a-937a8b5e13c3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:36.485829 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d15d9b6e-771a-4139-a57a-937a8b5e13c3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:36.518904 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d15d9b6e-771a-4139-a57a-937a8b5e13c3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052189 Aug 24 03:59:36.519461 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 454/914] 10.222.0.82 () {60 vars in 1343 bytes} [Wed Aug 24 03:59:36 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:36.583916 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-e255c757-5a0f-4f78-b220-b35f9a91ddb5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:36.585626 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-e255c757-5a0f-4f78-b220-b35f9a91ddb5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:36.588447 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:36.589117 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=82,nova_cell1:UPDATE=1 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:36.594677 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e255c757-5a0f-4f78-b220-b35f9a91ddb5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:36.595259 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e255c757-5a0f-4f78-b220-b35f9a91ddb5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:36.595908 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e255c757-5a0f-4f78-b220-b35f9a91ddb5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:36.596385 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e255c757-5a0f-4f78-b220-b35f9a91ddb5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:36.597015 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e255c757-5a0f-4f78-b220-b35f9a91ddb5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:36.597436 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e255c757-5a0f-4f78-b220-b35f9a91ddb5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:36.626075 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-e255c757-5a0f-4f78-b220-b35f9a91ddb5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Going to try to terminate instance {{(pid=127869) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:59:36.920093 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-e255c757-5a0f-4f78-b220-b35f9a91ddb5 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "DELETE /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 204 len: 0 microversion: 2.20 time: 0.339583 Aug 24 03:59:36.920677 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 461/915] 10.222.0.82 () {60 vars in 1280 bytes} [Wed Aug 24 03:59:36 2022] DELETE /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 03:59:36.930253 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ea6c13a7-944d-4396-86a0-da305796dead tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:36.930805 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ea6c13a7-944d-4396-86a0-da305796dead tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:36.939861 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea6c13a7-944d-4396-86a0-da305796dead tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:36.939861 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea6c13a7-944d-4396-86a0-da305796dead tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:36.939861 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea6c13a7-944d-4396-86a0-da305796dead tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:36.939861 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea6c13a7-944d-4396-86a0-da305796dead tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:36.940520 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea6c13a7-944d-4396-86a0-da305796dead tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:36.940811 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ea6c13a7-944d-4396-86a0-da305796dead tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:37.085210 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-ea6c13a7-944d-4396-86a0-da305796dead tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:37.093512 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-ea6c13a7-944d-4396-86a0-da305796dead tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:37.096587 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-ea6c13a7-944d-4396-86a0-da305796dead tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:37.097780 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ea6c13a7-944d-4396-86a0-da305796dead tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1724 microversion: 2.20 time: 0.172421 Aug 24 03:59:37.100600 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 455/916] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:59:36 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:59:38.125910 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-37dbe0ae-31a2-410d-aca4-523cb2059ac3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:38.127055 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-37dbe0ae-31a2-410d-aca4-523cb2059ac3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:38.134665 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-37dbe0ae-31a2-410d-aca4-523cb2059ac3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:38.135214 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-37dbe0ae-31a2-410d-aca4-523cb2059ac3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:38.135645 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-37dbe0ae-31a2-410d-aca4-523cb2059ac3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:38.136326 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-37dbe0ae-31a2-410d-aca4-523cb2059ac3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:38.136767 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-37dbe0ae-31a2-410d-aca4-523cb2059ac3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:38.137181 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-37dbe0ae-31a2-410d-aca4-523cb2059ac3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:38.277344 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-37dbe0ae-31a2-410d-aca4-523cb2059ac3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:38.285363 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-37dbe0ae-31a2-410d-aca4-523cb2059ac3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:38.287196 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-37dbe0ae-31a2-410d-aca4-523cb2059ac3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:38.288477 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-37dbe0ae-31a2-410d-aca4-523cb2059ac3 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1724 microversion: 2.20 time: 0.167470 Aug 24 03:59:38.289083 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 462/917] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:59:38 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:59:39.312665 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-98f00e95-41cf-4f49-8a44-6258dec40273 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:39.313342 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-98f00e95-41cf-4f49-8a44-6258dec40273 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:39.320285 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-98f00e95-41cf-4f49-8a44-6258dec40273 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:39.320771 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-98f00e95-41cf-4f49-8a44-6258dec40273 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:39.321205 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-98f00e95-41cf-4f49-8a44-6258dec40273 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:39.321906 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-98f00e95-41cf-4f49-8a44-6258dec40273 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:39.322439 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-98f00e95-41cf-4f49-8a44-6258dec40273 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:39.322890 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-98f00e95-41cf-4f49-8a44-6258dec40273 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:39.479852 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-98f00e95-41cf-4f49-8a44-6258dec40273 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:39.488768 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-98f00e95-41cf-4f49-8a44-6258dec40273 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:39.490653 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-98f00e95-41cf-4f49-8a44-6258dec40273 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:39.491921 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-98f00e95-41cf-4f49-8a44-6258dec40273 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1724 microversion: 2.20 time: 0.183516 Aug 24 03:59:39.503395 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 456/918] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:59:39 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:59:40.012071 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-bd5f0bc1-e61b-40c5-9685-81b0367c662d req-74d835c8-3703-4ac2-961c-1c5a83621d4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df85e6fe-54b4-456b-875d-7c3b6418c40e", "name": "network-vif-deleted", "tag": "b70bff9a-be9c-4b03-8c48-2151d8730e62"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:59:40.026336 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-bd5f0bc1-e61b-40c5-9685-81b0367c662d req-74d835c8-3703-4ac2-961c-1c5a83621d4e service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:40.026838 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-bd5f0bc1-e61b-40c5-9685-81b0367c662d req-74d835c8-3703-4ac2-961c-1c5a83621d4e service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:40.027262 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-bd5f0bc1-e61b-40c5-9685-81b0367c662d req-74d835c8-3703-4ac2-961c-1c5a83621d4e service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:40.038832 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-bd5f0bc1-e61b-40c5-9685-81b0367c662d req-74d835c8-3703-4ac2-961c-1c5a83621d4e service nova] Creating event network-vif-deleted:b70bff9a-be9c-4b03-8c48-2151d8730e62 for instance df85e6fe-54b4-456b-875d-7c3b6418c40e on hv-cinder-85426 Aug 24 03:59:40.043688 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-bd5f0bc1-e61b-40c5-9685-81b0367c662d req-74d835c8-3703-4ac2-961c-1c5a83621d4e service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035648 Aug 24 03:59:40.044999 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 463/919] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:59:40.518100 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-49e4f4a9-8cf4-405c-89f9-ed2109253a0a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:40.519432 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-49e4f4a9-8cf4-405c-89f9-ed2109253a0a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:40.526098 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49e4f4a9-8cf4-405c-89f9-ed2109253a0a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:40.535345 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49e4f4a9-8cf4-405c-89f9-ed2109253a0a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:40.535345 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49e4f4a9-8cf4-405c-89f9-ed2109253a0a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:40.535345 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49e4f4a9-8cf4-405c-89f9-ed2109253a0a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:40.535345 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49e4f4a9-8cf4-405c-89f9-ed2109253a0a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:40.535777 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49e4f4a9-8cf4-405c-89f9-ed2109253a0a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:40.566605 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49e4f4a9-8cf4-405c-89f9-ed2109253a0a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:40.567434 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49e4f4a9-8cf4-405c-89f9-ed2109253a0a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:40.568251 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-49e4f4a9-8cf4-405c-89f9-ed2109253a0a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:40.568777 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-49e4f4a9-8cf4-405c-89f9-ed2109253a0a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lazy-loading 'fault' on Instance uuid df85e6fe-54b4-456b-875d-7c3b6418c40e {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:59:40.620102 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-49e4f4a9-8cf4-405c-89f9-ed2109253a0a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:40.622158 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-49e4f4a9-8cf4-405c-89f9-ed2109253a0a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:40.623845 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-49e4f4a9-8cf4-405c-89f9-ed2109253a0a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a0f4d8b8c341ed85618e70adb2def4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feac5069d37149628113087d9d93912b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:40.625262 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-49e4f4a9-8cf4-405c-89f9-ed2109253a0a tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 200 len: 1371 microversion: 2.20 time: 0.112883 Aug 24 03:59:40.631819 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 457/920] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:59:40 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 1371 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:59:41.651743 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-5c2a2851-5664-4652-bd60-e3b1b4be322c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:41.652481 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-5c2a2851-5664-4652-bd60-e3b1b4be322c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:41.660953 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5c2a2851-5664-4652-bd60-e3b1b4be322c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:41.661440 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5c2a2851-5664-4652-bd60-e3b1b4be322c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:41.662146 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5c2a2851-5664-4652-bd60-e3b1b4be322c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:41.662602 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5c2a2851-5664-4652-bd60-e3b1b4be322c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:41.663330 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5c2a2851-5664-4652-bd60-e3b1b4be322c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:41.663948 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-5c2a2851-5664-4652-bd60-e3b1b4be322c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:41.679310 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.wsgi [None req-5c2a2851-5664-4652-bd60-e3b1b4be322c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] HTTP exception thrown: Instance df85e6fe-54b4-456b-875d-7c3b6418c40e could not be found. Aug 24 03:59:41.681205 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-5c2a2851-5664-4652-bd60-e3b1b4be322c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Request method failure captured: Aug 24 03:59:41.681205 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: request: GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e HTTP/1.1 Aug 24 03:59:41.681205 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept: application/json Aug 24 03:59:41.681205 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept-Encoding: identity Aug 24 03:59:41.681205 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Connection: close Aug 24 03:59:41.681205 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Length: 0 Aug 24 03:59:41.681205 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Type: application/json Aug 24 03:59:41.681205 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Host: 10.222.0.82 Aug 24 03:59:41.681205 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Openstack-System-Scope: None Aug 24 03:59:41.681205 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: User-Agent: python-urllib3/1.26.11 Aug 24 03:59:41.681205 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Auth-Token: gAAAAABjBaBwKioTEHcsapPMXzumUz8JfXs4PoUV_t0Zy5ObURRuX8BBtHkCsfhi7ljFttNNOP0mL5Fr25AjwSEs4D3IhDHzTWzDVQV3EzbMg-SOpApwzrV3x5b_OuWvZrG3wjFzPeJFOOIdQ1rLChA9ba-MjD4IVxtsZgT4cR-WfO1UOc5Jg88 Aug 24 03:59:41.681205 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Id: None Aug 24 03:59:41.681205 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Name: None Aug 24 03:59:41.681205 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Identity-Status: Confirmed Aug 24 03:59:41.681205 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Is-Admin-Project: True Aug 24 03:59:41.681205 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 03:59:41.681205 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Id: default Aug 24 03:59:41.681205 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Name: Default Aug 24 03:59:41.681205 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Id: feac5069d37149628113087d9d93912b Aug 24 03:59:41.681205 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1812885697 Aug 24 03:59:41.681205 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Role: member,reader Aug 24 03:59:41.681205 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Roles: member,reader Aug 24 03:59:41.690767 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/feac5069d37149628113087d9d93912b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/feac5069d37149628113087d9d93912b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/feac5069d37149628113087d9d93912b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_feac5069d37149628113087d9d93912b", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:59:41.690767 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1812885697 Aug 24 03:59:41.690767 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Id: feac5069d37149628113087d9d93912b Aug 24 03:59:41.690767 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1812885697 Aug 24 03:59:41.690767 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User: tempest-AttachVolumeShelveTestJSON-1812885697-project Aug 24 03:59:41.690767 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Id: default Aug 24 03:59:41.690767 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Name: Default Aug 24 03:59:41.690767 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Id: 87a0f4d8b8c341ed85618e70adb2def4 Aug 24 03:59:41.690767 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1812885697-project Aug 24 03:59:41.690767 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: method: > Aug 24 03:59:41.690767 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: exception: Instance df85e6fe-54b4-456b-875d-7c3b6418c40e could not be found. Aug 24 03:59:41.690767 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: action_args: {'id': 'df85e6fe-54b4-456b-875d-7c3b6418c40e'} Aug 24 03:59:41.691664 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:59:41.691664 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:41.691664 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:59:41.691664 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:59:41.691664 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:59:41.691664 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:59:41.691664 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:59:41.691664 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:59:41.691664 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:59:41.691664 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:59:41.691664 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df85e6fe-54b4-456b-875d-7c3b6418c40e could not be found. Aug 24 03:59:41.691664 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:41.691664 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:41.691664 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:41.691664 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:41.691664 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:41.691664 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:41.691664 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:59:41.691664 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:59:41.691664 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:59:41.693161 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:59:41.693161 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:59:41.693161 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:59:41.693161 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:59:41.693161 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:59:41.693161 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:59:41.693161 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:59:41.693161 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df85e6fe-54b4-456b-875d-7c3b6418c40e could not be found. Aug 24 03:59:41.693161 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:41.693161 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:41.693161 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:41.693161 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:41.693161 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:41.693161 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:41.693161 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:59:41.693161 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:59:41.693161 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df85e6fe-54b4-456b-875d-7c3b6418c40e could not be found. Aug 24 03:59:41.693161 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:41.694532 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-5c2a2851-5664-4652-bd60-e3b1b4be322c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Returning 404 to user: Instance df85e6fe-54b4-456b-875d-7c3b6418c40e could not be found. {{(pid=127869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:59:41.694532 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-5c2a2851-5664-4652-bd60-e3b1b4be322c tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 404 len: 111 microversion: 2.20 time: 0.035629 Aug 24 03:59:41.694532 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 464/921] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:59:41 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:59:41.695390 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d62bf5b4-939a-4d58-bdf4-be98aa4af7d2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '.version_select at 0x7f15541cea60>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:41.795357 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d62bf5b4-939a-4d58-bdf4-be98aa4af7d2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-418937145" status: 204 len: 0 microversion: 2.20 time: 0.103782 Aug 24 03:59:41.796438 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 458/922] 10.222.0.82 () {60 vars in 1259 bytes} [Wed Aug 24 03:59:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-418937145 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 03:59:41.973900 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-324e14e3-19a5-4e7b-bbda-af28d17ad12d tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:41.974402 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-324e14e3-19a5-4e7b-bbda-af28d17ad12d tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 6052f56c-fecc-42d7-a99a-e192c776be59] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:41.980192 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-324e14e3-19a5-4e7b-bbda-af28d17ad12d tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:41.980673 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-324e14e3-19a5-4e7b-bbda-af28d17ad12d tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:41.981112 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-324e14e3-19a5-4e7b-bbda-af28d17ad12d tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:41.981797 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-324e14e3-19a5-4e7b-bbda-af28d17ad12d tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:41.982251 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-324e14e3-19a5-4e7b-bbda-af28d17ad12d tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:41.982706 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-324e14e3-19a5-4e7b-bbda-af28d17ad12d tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:42.075191 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.objects.instance [None req-324e14e3-19a5-4e7b-bbda-af28d17ad12d tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lazy-loading 'services' on Instance uuid 6052f56c-fecc-42d7-a99a-e192c776be59 {{(pid=127869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:59:42.355011 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-324e14e3-19a5-4e7b-bbda-af28d17ad12d tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "DELETE /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59/os-volume_attachments/a40551c5-e659-43ab-84dc-5ca9d9577bdd" status: 202 len: 0 microversion: 2.1 time: 0.385894 Aug 24 03:59:42.363951 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 465/923] 10.222.0.82 () {58 vars in 1416 bytes} [Wed Aug 24 03:59:41 2022] DELETE /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59/os-volume_attachments/a40551c5-e659-43ab-84dc-5ca9d9577bdd => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:59:44.081795 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e847cc34-0b39-4aa1-b698-8923b4937ba2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:44.082373 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e847cc34-0b39-4aa1-b698-8923b4937ba2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:44.088971 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e847cc34-0b39-4aa1-b698-8923b4937ba2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:44.089452 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e847cc34-0b39-4aa1-b698-8923b4937ba2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:44.089885 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e847cc34-0b39-4aa1-b698-8923b4937ba2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:44.090612 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e847cc34-0b39-4aa1-b698-8923b4937ba2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:44.091070 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e847cc34-0b39-4aa1-b698-8923b4937ba2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:44.091495 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e847cc34-0b39-4aa1-b698-8923b4937ba2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:44.106276 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-e847cc34-0b39-4aa1-b698-8923b4937ba2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] HTTP exception thrown: Instance df85e6fe-54b4-456b-875d-7c3b6418c40e could not be found. Aug 24 03:59:44.107907 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e847cc34-0b39-4aa1-b698-8923b4937ba2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Request method failure captured: Aug 24 03:59:44.107907 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e HTTP/1.1 Aug 24 03:59:44.107907 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept: application/json Aug 24 03:59:44.107907 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept-Encoding: identity Aug 24 03:59:44.107907 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Connection: close Aug 24 03:59:44.107907 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Length: 0 Aug 24 03:59:44.107907 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Type: application/json Aug 24 03:59:44.107907 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Host: 10.222.0.82 Aug 24 03:59:44.107907 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Openstack-System-Scope: None Aug 24 03:59:44.107907 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.11 Aug 24 03:59:44.107907 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Auth-Token: gAAAAABjBaBwKioTEHcsapPMXzumUz8JfXs4PoUV_t0Zy5ObURRuX8BBtHkCsfhi7ljFttNNOP0mL5Fr25AjwSEs4D3IhDHzTWzDVQV3EzbMg-SOpApwzrV3x5b_OuWvZrG3wjFzPeJFOOIdQ1rLChA9ba-MjD4IVxtsZgT4cR-WfO1UOc5Jg88 Aug 24 03:59:44.107907 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Id: None Aug 24 03:59:44.107907 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Name: None Aug 24 03:59:44.107907 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Identity-Status: Confirmed Aug 24 03:59:44.107907 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Is-Admin-Project: True Aug 24 03:59:44.107907 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 03:59:44.107907 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Id: default Aug 24 03:59:44.107907 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Name: Default Aug 24 03:59:44.107907 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Id: feac5069d37149628113087d9d93912b Aug 24 03:59:44.107907 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1812885697 Aug 24 03:59:44.107907 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Role: member,reader Aug 24 03:59:44.107907 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Roles: member,reader Aug 24 03:59:44.109777 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/feac5069d37149628113087d9d93912b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/feac5069d37149628113087d9d93912b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/feac5069d37149628113087d9d93912b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_feac5069d37149628113087d9d93912b", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:59:44.109777 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1812885697 Aug 24 03:59:44.109777 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Id: feac5069d37149628113087d9d93912b Aug 24 03:59:44.109777 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1812885697 Aug 24 03:59:44.109777 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User: tempest-AttachVolumeShelveTestJSON-1812885697-project Aug 24 03:59:44.109777 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Id: default Aug 24 03:59:44.109777 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Name: Default Aug 24 03:59:44.109777 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Id: 87a0f4d8b8c341ed85618e70adb2def4 Aug 24 03:59:44.109777 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1812885697-project Aug 24 03:59:44.109777 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: method: > Aug 24 03:59:44.109777 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: exception: Instance df85e6fe-54b4-456b-875d-7c3b6418c40e could not be found. Aug 24 03:59:44.109777 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: action_args: {'id': 'df85e6fe-54b4-456b-875d-7c3b6418c40e'} Aug 24 03:59:44.111337 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:59:44.111337 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:44.111337 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:59:44.111337 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:59:44.111337 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:59:44.111337 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:59:44.111337 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:59:44.111337 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:59:44.111337 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:59:44.111337 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:59:44.111337 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df85e6fe-54b4-456b-875d-7c3b6418c40e could not be found. Aug 24 03:59:44.111337 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:44.111337 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:44.111337 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:44.111337 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:44.111337 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:44.111337 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:44.111337 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:59:44.111337 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:59:44.111337 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:59:44.112789 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:59:44.112789 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:59:44.112789 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:59:44.112789 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:59:44.112789 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:59:44.112789 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:59:44.112789 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:59:44.112789 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:59:44.112789 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:59:44.112789 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df85e6fe-54b4-456b-875d-7c3b6418c40e could not be found. Aug 24 03:59:44.112789 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:44.112789 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:44.112789 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:44.112789 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:44.112789 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:44.112789 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:44.112789 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:59:44.112789 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:59:44.112789 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df85e6fe-54b4-456b-875d-7c3b6418c40e could not be found. Aug 24 03:59:44.112789 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:44.116503 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e847cc34-0b39-4aa1-b698-8923b4937ba2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Returning 404 to user: Instance df85e6fe-54b4-456b-875d-7c3b6418c40e could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:59:44.116503 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e847cc34-0b39-4aa1-b698-8923b4937ba2 tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "DELETE /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 404 len: 111 microversion: 2.20 time: 0.032455 Aug 24 03:59:44.116503 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 459/924] 10.222.0.82 () {60 vars in 1280 bytes} [Wed Aug 24 03:59:44 2022] DELETE /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:59:44.119557 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-cb3a15fb-61c8-4c25-afa1-59a34317934b tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:44.120250 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-cb3a15fb-61c8-4c25-afa1-59a34317934b tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: df85e6fe-54b4-456b-875d-7c3b6418c40e] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:44.127207 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cb3a15fb-61c8-4c25-afa1-59a34317934b tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:44.128323 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cb3a15fb-61c8-4c25-afa1-59a34317934b tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:44.130050 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cb3a15fb-61c8-4c25-afa1-59a34317934b tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:44.130157 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cb3a15fb-61c8-4c25-afa1-59a34317934b tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:44.130993 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cb3a15fb-61c8-4c25-afa1-59a34317934b tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:44.131772 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cb3a15fb-61c8-4c25-afa1-59a34317934b tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:44.149466 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.wsgi [None req-cb3a15fb-61c8-4c25-afa1-59a34317934b tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] HTTP exception thrown: Instance df85e6fe-54b4-456b-875d-7c3b6418c40e could not be found. Aug 24 03:59:44.151220 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-cb3a15fb-61c8-4c25-afa1-59a34317934b tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Request method failure captured: Aug 24 03:59:44.151220 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: request: GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e HTTP/1.1 Aug 24 03:59:44.151220 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept: application/json Aug 24 03:59:44.151220 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept-Encoding: identity Aug 24 03:59:44.151220 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Connection: close Aug 24 03:59:44.151220 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Length: 0 Aug 24 03:59:44.151220 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Type: application/json Aug 24 03:59:44.151220 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Host: 10.222.0.82 Aug 24 03:59:44.151220 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Openstack-System-Scope: None Aug 24 03:59:44.151220 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: User-Agent: python-urllib3/1.26.11 Aug 24 03:59:44.151220 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Auth-Token: gAAAAABjBaBwKioTEHcsapPMXzumUz8JfXs4PoUV_t0Zy5ObURRuX8BBtHkCsfhi7ljFttNNOP0mL5Fr25AjwSEs4D3IhDHzTWzDVQV3EzbMg-SOpApwzrV3x5b_OuWvZrG3wjFzPeJFOOIdQ1rLChA9ba-MjD4IVxtsZgT4cR-WfO1UOc5Jg88 Aug 24 03:59:44.151220 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Id: None Aug 24 03:59:44.151220 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Name: None Aug 24 03:59:44.151220 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Identity-Status: Confirmed Aug 24 03:59:44.151220 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Is-Admin-Project: True Aug 24 03:59:44.151220 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 03:59:44.151220 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Id: default Aug 24 03:59:44.151220 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Name: Default Aug 24 03:59:44.151220 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Id: feac5069d37149628113087d9d93912b Aug 24 03:59:44.151220 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1812885697 Aug 24 03:59:44.151220 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Role: member,reader Aug 24 03:59:44.151220 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Roles: member,reader Aug 24 03:59:44.152989 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/feac5069d37149628113087d9d93912b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/feac5069d37149628113087d9d93912b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/feac5069d37149628113087d9d93912b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_feac5069d37149628113087d9d93912b", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:59:44.152989 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1812885697 Aug 24 03:59:44.152989 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Id: feac5069d37149628113087d9d93912b Aug 24 03:59:44.152989 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1812885697 Aug 24 03:59:44.152989 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User: tempest-AttachVolumeShelveTestJSON-1812885697-project Aug 24 03:59:44.152989 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Id: default Aug 24 03:59:44.152989 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Name: Default Aug 24 03:59:44.152989 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Id: 87a0f4d8b8c341ed85618e70adb2def4 Aug 24 03:59:44.152989 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1812885697-project Aug 24 03:59:44.152989 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: method: > Aug 24 03:59:44.152989 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: exception: Instance df85e6fe-54b4-456b-875d-7c3b6418c40e could not be found. Aug 24 03:59:44.152989 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: action_args: {'id': 'df85e6fe-54b4-456b-875d-7c3b6418c40e'} Aug 24 03:59:44.154000 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:59:44.154000 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:44.154000 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:59:44.154000 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:59:44.154000 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:59:44.154000 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:59:44.154000 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:59:44.154000 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:59:44.154000 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:59:44.154000 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:59:44.154000 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df85e6fe-54b4-456b-875d-7c3b6418c40e could not be found. Aug 24 03:59:44.154000 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:44.154000 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:44.154000 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:44.154000 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:44.154000 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:44.154000 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:44.154000 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:59:44.154000 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:59:44.154000 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:59:44.155365 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:59:44.155365 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:59:44.155365 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:59:44.155365 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:59:44.155365 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:59:44.155365 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:59:44.155365 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:59:44.155365 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df85e6fe-54b4-456b-875d-7c3b6418c40e could not be found. Aug 24 03:59:44.155365 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:44.155365 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:44.155365 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:44.155365 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:44.155365 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:44.155365 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:44.155365 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:59:44.155365 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:59:44.155365 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df85e6fe-54b4-456b-875d-7c3b6418c40e could not be found. Aug 24 03:59:44.155365 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:44.157322 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-cb3a15fb-61c8-4c25-afa1-59a34317934b tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Returning 404 to user: Instance df85e6fe-54b4-456b-875d-7c3b6418c40e could not be found. {{(pid=127869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:59:44.157322 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-cb3a15fb-61c8-4c25-afa1-59a34317934b tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e" status: 404 len: 111 microversion: 2.20 time: 0.038642 Aug 24 03:59:44.157322 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 466/925] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:59:44 2022] GET /compute/v2.1/servers/df85e6fe-54b4-456b-875d-7c3b6418c40e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:59:44.568280 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-9bc1f7b4-b924-4bfc-aea8-126b0f2ac23b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:44.568774 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9bc1f7b4-b924-4bfc-aea8-126b0f2ac23b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 6052f56c-fecc-42d7-a99a-e192c776be59] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:44.574888 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9bc1f7b4-b924-4bfc-aea8-126b0f2ac23b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:44.575368 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9bc1f7b4-b924-4bfc-aea8-126b0f2ac23b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:44.575983 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9bc1f7b4-b924-4bfc-aea8-126b0f2ac23b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:44.576672 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9bc1f7b4-b924-4bfc-aea8-126b0f2ac23b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:44.577284 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9bc1f7b4-b924-4bfc-aea8-126b0f2ac23b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:44.577710 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-9bc1f7b4-b924-4bfc-aea8-126b0f2ac23b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:44.604117 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-9bc1f7b4-b924-4bfc-aea8-126b0f2ac23b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 6052f56c-fecc-42d7-a99a-e192c776be59] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:59:44.954347 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-9bc1f7b4-b924-4bfc-aea8-126b0f2ac23b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "DELETE /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59" status: 204 len: 0 microversion: 2.1 time: 0.389587 Aug 24 03:59:44.954964 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 460/926] 10.222.0.82 () {58 vars in 1239 bytes} [Wed Aug 24 03:59:44 2022] DELETE /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:59:44.963490 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-cd3d9401-8a9c-4be0-ad64-7c423c878a1c tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:44.964323 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-cd3d9401-8a9c-4be0-ad64-7c423c878a1c tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 6052f56c-fecc-42d7-a99a-e192c776be59] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:44.971162 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cd3d9401-8a9c-4be0-ad64-7c423c878a1c tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:44.971649 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cd3d9401-8a9c-4be0-ad64-7c423c878a1c tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:44.972083 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cd3d9401-8a9c-4be0-ad64-7c423c878a1c tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:44.972776 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cd3d9401-8a9c-4be0-ad64-7c423c878a1c tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:44.973228 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cd3d9401-8a9c-4be0-ad64-7c423c878a1c tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:44.973650 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-cd3d9401-8a9c-4be0-ad64-7c423c878a1c tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:45.122759 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-cd3d9401-8a9c-4be0-ad64-7c423c878a1c tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206cb5005354ab4a716efb525c633e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3d57c8abbd49e69c0caad57f7f9815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:45.131083 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-cd3d9401-8a9c-4be0-ad64-7c423c878a1c tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59" status: 200 len: 1511 microversion: 2.1 time: 0.171403 Aug 24 03:59:45.131642 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 467/927] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:44 2022] GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59 => generated 1511 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:45.544613 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1bcfef1a-e074-418d-a9bc-adea3b24feae tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:45.545279 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1bcfef1a-e074-418d-a9bc-adea3b24feae tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:45.552927 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1bcfef1a-e074-418d-a9bc-adea3b24feae tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:45.553414 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1bcfef1a-e074-418d-a9bc-adea3b24feae tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:45.553846 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1bcfef1a-e074-418d-a9bc-adea3b24feae tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:45.554580 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1bcfef1a-e074-418d-a9bc-adea3b24feae tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:45.555037 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1bcfef1a-e074-418d-a9bc-adea3b24feae tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:45.555490 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1bcfef1a-e074-418d-a9bc-adea3b24feae tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:45.569951 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-1bcfef1a-e074-418d-a9bc-adea3b24feae tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] HTTP exception thrown: Instance b8b22210-7e08-4f01-bf00-d84b0e5e34d7 could not be found. Aug 24 03:59:45.571654 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1bcfef1a-e074-418d-a9bc-adea3b24feae tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Request method failure captured: Aug 24 03:59:45.571654 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 HTTP/1.1 Aug 24 03:59:45.571654 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept: application/json Aug 24 03:59:45.571654 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept-Encoding: identity Aug 24 03:59:45.571654 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Connection: close Aug 24 03:59:45.571654 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Length: 0 Aug 24 03:59:45.571654 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Type: application/json Aug 24 03:59:45.571654 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Host: 10.222.0.82 Aug 24 03:59:45.571654 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Openstack-System-Scope: None Aug 24 03:59:45.571654 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.11 Aug 24 03:59:45.571654 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Auth-Token: gAAAAABjBaBwKioTEHcsapPMXzumUz8JfXs4PoUV_t0Zy5ObURRuX8BBtHkCsfhi7ljFttNNOP0mL5Fr25AjwSEs4D3IhDHzTWzDVQV3EzbMg-SOpApwzrV3x5b_OuWvZrG3wjFzPeJFOOIdQ1rLChA9ba-MjD4IVxtsZgT4cR-WfO1UOc5Jg88 Aug 24 03:59:45.571654 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Id: None Aug 24 03:59:45.571654 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Name: None Aug 24 03:59:45.571654 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Identity-Status: Confirmed Aug 24 03:59:45.571654 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Is-Admin-Project: True Aug 24 03:59:45.571654 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 03:59:45.571654 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Id: default Aug 24 03:59:45.571654 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Name: Default Aug 24 03:59:45.571654 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Id: feac5069d37149628113087d9d93912b Aug 24 03:59:45.571654 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1812885697 Aug 24 03:59:45.571654 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Role: member,reader Aug 24 03:59:45.571654 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Roles: member,reader Aug 24 03:59:45.575671 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/feac5069d37149628113087d9d93912b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/feac5069d37149628113087d9d93912b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/feac5069d37149628113087d9d93912b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_feac5069d37149628113087d9d93912b", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:59:45.575671 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1812885697 Aug 24 03:59:45.575671 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Id: feac5069d37149628113087d9d93912b Aug 24 03:59:45.575671 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1812885697 Aug 24 03:59:45.575671 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User: tempest-AttachVolumeShelveTestJSON-1812885697-project Aug 24 03:59:45.575671 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Id: default Aug 24 03:59:45.575671 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Name: Default Aug 24 03:59:45.575671 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Id: 87a0f4d8b8c341ed85618e70adb2def4 Aug 24 03:59:45.575671 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1812885697-project Aug 24 03:59:45.575671 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: method: > Aug 24 03:59:45.575671 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: exception: Instance b8b22210-7e08-4f01-bf00-d84b0e5e34d7 could not be found. Aug 24 03:59:45.575671 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: action_args: {'id': 'b8b22210-7e08-4f01-bf00-d84b0e5e34d7'} Aug 24 03:59:45.576417 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:59:45.576417 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:45.576417 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:59:45.576417 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:59:45.576417 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:59:45.576417 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:59:45.576417 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:59:45.576417 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:59:45.576417 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:59:45.576417 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:59:45.576417 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8b22210-7e08-4f01-bf00-d84b0e5e34d7 could not be found. Aug 24 03:59:45.576417 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:45.576417 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:45.576417 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:45.576417 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:45.576417 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:45.576417 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:45.576417 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:59:45.576417 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:59:45.576417 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:59:45.577707 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:59:45.577707 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:59:45.577707 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:59:45.577707 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:59:45.577707 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:59:45.577707 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:59:45.577707 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:59:45.577707 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:59:45.577707 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:59:45.577707 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8b22210-7e08-4f01-bf00-d84b0e5e34d7 could not be found. Aug 24 03:59:45.577707 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:45.577707 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:45.577707 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:45.577707 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:45.577707 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:45.577707 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:45.577707 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:59:45.577707 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:59:45.577707 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8b22210-7e08-4f01-bf00-d84b0e5e34d7 could not be found. Aug 24 03:59:45.577707 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:45.580119 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1bcfef1a-e074-418d-a9bc-adea3b24feae tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Returning 404 to user: Instance b8b22210-7e08-4f01-bf00-d84b0e5e34d7 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:59:45.580119 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1bcfef1a-e074-418d-a9bc-adea3b24feae tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "DELETE /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 404 len: 111 microversion: 2.20 time: 0.032650 Aug 24 03:59:45.580119 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 461/928] 10.222.0.82 () {60 vars in 1280 bytes} [Wed Aug 24 03:59:45 2022] DELETE /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 03:59:45.582643 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-7512900c-cbc8-4573-a52a-d8afe31b20da tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:45.583251 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-7512900c-cbc8-4573-a52a-d8afe31b20da tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] [instance: b8b22210-7e08-4f01-bf00-d84b0e5e34d7] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:45.589142 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7512900c-cbc8-4573-a52a-d8afe31b20da tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:45.589612 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7512900c-cbc8-4573-a52a-d8afe31b20da tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:45.590044 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7512900c-cbc8-4573-a52a-d8afe31b20da tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:45.590876 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7512900c-cbc8-4573-a52a-d8afe31b20da tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:45.591330 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7512900c-cbc8-4573-a52a-d8afe31b20da tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:45.591752 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7512900c-cbc8-4573-a52a-d8afe31b20da tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:45.605497 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.wsgi [None req-7512900c-cbc8-4573-a52a-d8afe31b20da tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] HTTP exception thrown: Instance b8b22210-7e08-4f01-bf00-d84b0e5e34d7 could not be found. Aug 24 03:59:45.607063 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-7512900c-cbc8-4573-a52a-d8afe31b20da tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Request method failure captured: Aug 24 03:59:45.607063 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: request: GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 HTTP/1.1 Aug 24 03:59:45.607063 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept: application/json Aug 24 03:59:45.607063 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept-Encoding: identity Aug 24 03:59:45.607063 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Connection: close Aug 24 03:59:45.607063 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Length: 0 Aug 24 03:59:45.607063 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Type: application/json Aug 24 03:59:45.607063 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Host: 10.222.0.82 Aug 24 03:59:45.607063 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Openstack-System-Scope: None Aug 24 03:59:45.607063 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: User-Agent: python-urllib3/1.26.11 Aug 24 03:59:45.607063 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Auth-Token: gAAAAABjBaBwKioTEHcsapPMXzumUz8JfXs4PoUV_t0Zy5ObURRuX8BBtHkCsfhi7ljFttNNOP0mL5Fr25AjwSEs4D3IhDHzTWzDVQV3EzbMg-SOpApwzrV3x5b_OuWvZrG3wjFzPeJFOOIdQ1rLChA9ba-MjD4IVxtsZgT4cR-WfO1UOc5Jg88 Aug 24 03:59:45.607063 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Id: None Aug 24 03:59:45.607063 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Name: None Aug 24 03:59:45.607063 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Identity-Status: Confirmed Aug 24 03:59:45.607063 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Is-Admin-Project: True Aug 24 03:59:45.607063 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 03:59:45.607063 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Id: default Aug 24 03:59:45.607063 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Name: Default Aug 24 03:59:45.607063 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Id: feac5069d37149628113087d9d93912b Aug 24 03:59:45.607063 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1812885697 Aug 24 03:59:45.607063 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Role: member,reader Aug 24 03:59:45.607063 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Roles: member,reader Aug 24 03:59:45.608859 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/feac5069d37149628113087d9d93912b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/feac5069d37149628113087d9d93912b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/feac5069d37149628113087d9d93912b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_feac5069d37149628113087d9d93912b", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:59:45.608859 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1812885697 Aug 24 03:59:45.608859 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Id: feac5069d37149628113087d9d93912b Aug 24 03:59:45.608859 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1812885697 Aug 24 03:59:45.608859 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User: tempest-AttachVolumeShelveTestJSON-1812885697-project Aug 24 03:59:45.608859 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Id: default Aug 24 03:59:45.608859 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Name: Default Aug 24 03:59:45.608859 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Id: 87a0f4d8b8c341ed85618e70adb2def4 Aug 24 03:59:45.608859 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1812885697-project Aug 24 03:59:45.608859 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: method: > Aug 24 03:59:45.608859 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: exception: Instance b8b22210-7e08-4f01-bf00-d84b0e5e34d7 could not be found. Aug 24 03:59:45.608859 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: action_args: {'id': 'b8b22210-7e08-4f01-bf00-d84b0e5e34d7'} Aug 24 03:59:45.609883 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:59:45.609883 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:45.609883 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:59:45.609883 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:59:45.609883 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:59:45.609883 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:59:45.609883 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:59:45.609883 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:59:45.609883 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:59:45.609883 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:59:45.609883 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8b22210-7e08-4f01-bf00-d84b0e5e34d7 could not be found. Aug 24 03:59:45.609883 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:45.609883 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:45.609883 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:45.609883 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:45.609883 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:45.609883 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:45.609883 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:59:45.609883 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:59:45.609883 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:59:45.611370 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:59:45.611370 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:59:45.611370 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:59:45.611370 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:59:45.611370 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:59:45.611370 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:59:45.611370 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:59:45.611370 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8b22210-7e08-4f01-bf00-d84b0e5e34d7 could not be found. Aug 24 03:59:45.611370 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:45.611370 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:45.611370 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:45.611370 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:45.611370 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:45.611370 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:45.611370 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:59:45.611370 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:59:45.611370 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8b22210-7e08-4f01-bf00-d84b0e5e34d7 could not be found. Aug 24 03:59:45.611370 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 03:59:45.612982 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-7512900c-cbc8-4573-a52a-d8afe31b20da tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] Returning 404 to user: Instance b8b22210-7e08-4f01-bf00-d84b0e5e34d7 could not be found. {{(pid=127869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:59:45.612982 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-7512900c-cbc8-4573-a52a-d8afe31b20da tempest-AttachVolumeShelveTestJSON-1812885697 tempest-AttachVolumeShelveTestJSON-1812885697-project] 10.222.0.82 "GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7" status: 404 len: 111 microversion: 2.20 time: 0.030364 Aug 24 03:59:45.612982 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 468/929] 10.222.0.82 () {60 vars in 1277 bytes} [Wed Aug 24 03:59:45 2022] GET /compute/v2.1/servers/b8b22210-7e08-4f01-bf00-d84b0e5e34d7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:59:46.160265 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-961f47fe-b404-43a7-90dd-13162cd5c97d tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:46.161540 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-961f47fe-b404-43a7-90dd-13162cd5c97d tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 6052f56c-fecc-42d7-a99a-e192c776be59] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:46.169540 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-961f47fe-b404-43a7-90dd-13162cd5c97d tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:46.170084 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-961f47fe-b404-43a7-90dd-13162cd5c97d tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:46.171126 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-961f47fe-b404-43a7-90dd-13162cd5c97d tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:46.172643 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-961f47fe-b404-43a7-90dd-13162cd5c97d tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:46.173161 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-961f47fe-b404-43a7-90dd-13162cd5c97d tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:46.173595 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-961f47fe-b404-43a7-90dd-13162cd5c97d tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:46.326027 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-961f47fe-b404-43a7-90dd-13162cd5c97d tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206cb5005354ab4a716efb525c633e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3d57c8abbd49e69c0caad57f7f9815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:46.336043 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-961f47fe-b404-43a7-90dd-13162cd5c97d tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59" status: 200 len: 1511 microversion: 2.1 time: 0.183276 Aug 24 03:59:46.336997 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 462/930] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:46 2022] GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59 => generated 1511 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:47.358596 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-91496c2e-9776-4fc6-82d4-8a4b912b6f01 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:47.359955 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-91496c2e-9776-4fc6-82d4-8a4b912b6f01 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 6052f56c-fecc-42d7-a99a-e192c776be59] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:47.366473 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-91496c2e-9776-4fc6-82d4-8a4b912b6f01 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:47.366987 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-91496c2e-9776-4fc6-82d4-8a4b912b6f01 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:47.367423 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-91496c2e-9776-4fc6-82d4-8a4b912b6f01 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:47.368116 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-91496c2e-9776-4fc6-82d4-8a4b912b6f01 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:47.368558 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-91496c2e-9776-4fc6-82d4-8a4b912b6f01 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:47.368983 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-91496c2e-9776-4fc6-82d4-8a4b912b6f01 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:47.680488 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-91496c2e-9776-4fc6-82d4-8a4b912b6f01 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206cb5005354ab4a716efb525c633e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3d57c8abbd49e69c0caad57f7f9815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:47.691206 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-91496c2e-9776-4fc6-82d4-8a4b912b6f01 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59" status: 200 len: 1511 microversion: 2.1 time: 0.336356 Aug 24 03:59:47.691787 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 469/931] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:47 2022] GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59 => generated 1511 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:47.966925 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-696a7cff-1f80-43d2-89f7-a39fc731bb55 req-4c0ac5d9-1662-4941-8775-e7ce4fb9140d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6052f56c-fecc-42d7-a99a-e192c776be59", "name": "network-vif-deleted", "tag": "9d1a4a2e-e6c4-42f5-a574-515f4e9d090c"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:59:47.983412 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-696a7cff-1f80-43d2-89f7-a39fc731bb55 req-4c0ac5d9-1662-4941-8775-e7ce4fb9140d service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:47.985535 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-696a7cff-1f80-43d2-89f7-a39fc731bb55 req-4c0ac5d9-1662-4941-8775-e7ce4fb9140d service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:47.985979 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-696a7cff-1f80-43d2-89f7-a39fc731bb55 req-4c0ac5d9-1662-4941-8775-e7ce4fb9140d service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:48.005967 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-696a7cff-1f80-43d2-89f7-a39fc731bb55 req-4c0ac5d9-1662-4941-8775-e7ce4fb9140d service nova] Creating event network-vif-deleted:9d1a4a2e-e6c4-42f5-a574-515f4e9d090c for instance 6052f56c-fecc-42d7-a99a-e192c776be59 on hv-cinder-85426 Aug 24 03:59:48.011453 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-696a7cff-1f80-43d2-89f7-a39fc731bb55 req-4c0ac5d9-1662-4941-8775-e7ce4fb9140d service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051395 Aug 24 03:59:48.012284 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 463/932] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 03:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:59:48.713687 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-1fbfabf2-ee58-4e84-9eac-a46905327605 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:48.714314 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-1fbfabf2-ee58-4e84-9eac-a46905327605 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 6052f56c-fecc-42d7-a99a-e192c776be59] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:48.725733 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1fbfabf2-ee58-4e84-9eac-a46905327605 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:48.725733 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1fbfabf2-ee58-4e84-9eac-a46905327605 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:48.725733 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1fbfabf2-ee58-4e84-9eac-a46905327605 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:48.725733 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1fbfabf2-ee58-4e84-9eac-a46905327605 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:48.726176 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1fbfabf2-ee58-4e84-9eac-a46905327605 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:48.726176 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1fbfabf2-ee58-4e84-9eac-a46905327605 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:48.756158 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1fbfabf2-ee58-4e84-9eac-a46905327605 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:48.756628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1fbfabf2-ee58-4e84-9eac-a46905327605 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:48.757080 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1fbfabf2-ee58-4e84-9eac-a46905327605 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:48.757529 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.objects.instance [None req-1fbfabf2-ee58-4e84-9eac-a46905327605 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lazy-loading 'fault' on Instance uuid 6052f56c-fecc-42d7-a99a-e192c776be59 {{(pid=127869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:59:48.814165 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-1fbfabf2-ee58-4e84-9eac-a46905327605 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206cb5005354ab4a716efb525c633e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3d57c8abbd49e69c0caad57f7f9815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:48.821811 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-1fbfabf2-ee58-4e84-9eac-a46905327605 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59" status: 200 len: 1308 microversion: 2.1 time: 0.112024 Aug 24 03:59:48.826542 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 470/933] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:48 2022] GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59 => generated 1308 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:49.845413 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ba873a59-2795-4bcf-bc87-2369bed375df tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:49.846123 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ba873a59-2795-4bcf-bc87-2369bed375df tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 6052f56c-fecc-42d7-a99a-e192c776be59] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:49.852792 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba873a59-2795-4bcf-bc87-2369bed375df tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:49.853280 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba873a59-2795-4bcf-bc87-2369bed375df tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:49.853717 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba873a59-2795-4bcf-bc87-2369bed375df tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:49.854409 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba873a59-2795-4bcf-bc87-2369bed375df tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:49.854896 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba873a59-2795-4bcf-bc87-2369bed375df tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:49.855313 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ba873a59-2795-4bcf-bc87-2369bed375df tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:49.873338 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-ba873a59-2795-4bcf-bc87-2369bed375df tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] HTTP exception thrown: Instance 6052f56c-fecc-42d7-a99a-e192c776be59 could not be found. Aug 24 03:59:49.876450 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ba873a59-2795-4bcf-bc87-2369bed375df tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Request method failure captured: Aug 24 03:59:49.876450 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59 HTTP/1.1 Aug 24 03:59:49.876450 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept: application/json Aug 24 03:59:49.876450 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept-Encoding: identity Aug 24 03:59:49.876450 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Connection: close Aug 24 03:59:49.876450 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Length: 0 Aug 24 03:59:49.876450 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Type: application/json Aug 24 03:59:49.876450 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Host: 10.222.0.82 Aug 24 03:59:49.876450 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Openstack-System-Scope: None Aug 24 03:59:49.876450 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.11 Aug 24 03:59:49.876450 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Auth-Token: gAAAAABjBaHteSKONEGDb0C5U4IGCoqZCVDQ9kvVP-g2i_ckkrJKz0LZ3bSQrc2f2zZv8bw-y1aGNHHXTy3lVY4wa-g-UWfeA7BOavmb7iBYUvTmXwj1fUl-GV4drti1VgYqVp3orB9sBT5aKCMSc66ZlHUnUKo3exEtA6eBKVYgGR0oFDnSnqc Aug 24 03:59:49.876450 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Id: None Aug 24 03:59:49.876450 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Name: None Aug 24 03:59:49.876450 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Identity-Status: Confirmed Aug 24 03:59:49.876450 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Is-Admin-Project: True Aug 24 03:59:49.876450 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Id: default Aug 24 03:59:49.876450 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Name: Default Aug 24 03:59:49.876450 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Id: 6e3d57c8abbd49e69c0caad57f7f9815 Aug 24 03:59:49.876450 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1580980535 Aug 24 03:59:49.876450 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Role: member,reader Aug 24 03:59:49.876450 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Roles: member,reader Aug 24 03:59:49.878222 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/6e3d57c8abbd49e69c0caad57f7f9815"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/6e3d57c8abbd49e69c0caad57f7f9815"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/6e3d57c8abbd49e69c0caad57f7f9815"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_6e3d57c8abbd49e69c0caad57f7f9815", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 03:59:49.878222 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant: tempest-VolumesSnapshotTestJSON-1580980535 Aug 24 03:59:49.878222 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Id: 6e3d57c8abbd49e69c0caad57f7f9815 Aug 24 03:59:49.878222 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1580980535 Aug 24 03:59:49.878222 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User: tempest-VolumesSnapshotTestJSON-1580980535-project Aug 24 03:59:49.878222 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Id: default Aug 24 03:59:49.878222 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Name: Default Aug 24 03:59:49.878222 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Id: 2206cb5005354ab4a716efb525c633e7 Aug 24 03:59:49.878222 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Name: tempest-VolumesSnapshotTestJSON-1580980535-project Aug 24 03:59:49.878222 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: method: > Aug 24 03:59:49.878222 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: exception: Instance 6052f56c-fecc-42d7-a99a-e192c776be59 could not be found. Aug 24 03:59:49.878222 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: action_args: {'id': '6052f56c-fecc-42d7-a99a-e192c776be59'} Aug 24 03:59:49.879063 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:59:49.879063 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:49.879063 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:59:49.879063 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:59:49.879063 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:59:49.879063 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:59:49.879063 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:59:49.879063 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:59:49.879063 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:59:49.879063 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:59:49.879063 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6052f56c-fecc-42d7-a99a-e192c776be59 could not be found. Aug 24 03:59:49.879063 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:49.879063 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:49.879063 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:49.879063 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:49.879063 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:49.879063 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:49.879063 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:59:49.879063 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:59:49.879063 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:59:49.881908 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:59:49.881908 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:59:49.881908 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:59:49.881908 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:59:49.881908 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:59:49.881908 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:59:49.881908 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:59:49.881908 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6052f56c-fecc-42d7-a99a-e192c776be59 could not be found. Aug 24 03:59:49.881908 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:49.881908 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:49.881908 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:49.881908 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:49.881908 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:49.881908 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:49.881908 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:59:49.881908 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:59:49.881908 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6052f56c-fecc-42d7-a99a-e192c776be59 could not be found. Aug 24 03:59:49.881908 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 03:59:49.884336 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ba873a59-2795-4bcf-bc87-2369bed375df tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Returning 404 to user: Instance 6052f56c-fecc-42d7-a99a-e192c776be59 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:59:49.884336 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ba873a59-2795-4bcf-bc87-2369bed375df tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59" status: 404 len: 111 microversion: 2.1 time: 0.038005 Aug 24 03:59:49.884336 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 464/934] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:49 2022] GET /compute/v2.1/servers/6052f56c-fecc-42d7-a99a-e192c776be59 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:00:03.936834 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-07689e86-7f9d-4102-92a0-1c798c7bf92c tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2080849761", "imageRef": "c32522f7-22a8-45d4-a51e-f17637def2e1", "flavorRef": "452", "networks": [{"uuid": "95c2c737-2f6c-4c40-b04c-f6d97ffe7eda"}]}} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:00:03.945549 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:03.946203 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:03.996182 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.network.neutron [None req-07689e86-7f9d-4102-92a0-1c798c7bf92c tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] validate_networks() for [('95c2c737-2f6c-4c40-b04c-f6d97ffe7eda', None, None, None, None, None)] {{(pid=127869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:00:04.383984 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-07689e86-7f9d-4102-92a0-1c798c7bf92c tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Flavor limits 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:00:04.383984 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-07689e86-7f9d-4102-92a0-1c798c7bf92c tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Image limits 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:00:04.384776 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-07689e86-7f9d-4102-92a0-1c798c7bf92c tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Flavor pref 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:00:04.385799 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-07689e86-7f9d-4102-92a0-1c798c7bf92c tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Image pref 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:00:04.386862 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-07689e86-7f9d-4102-92a0-1c798c7bf92c tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:00:04.402691 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-07689e86-7f9d-4102-92a0-1c798c7bf92c tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:04.402691 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-07689e86-7f9d-4102-92a0-1c798c7bf92c tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:04.402691 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-07689e86-7f9d-4102-92a0-1c798c7bf92c tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:04.404204 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-07689e86-7f9d-4102-92a0-1c798c7bf92c tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:04.404676 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-07689e86-7f9d-4102-92a0-1c798c7bf92c tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:04.405111 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-07689e86-7f9d-4102-92a0-1c798c7bf92c tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:04.425765 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.quota [None req-07689e86-7f9d-4102-92a0-1c798c7bf92c tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Getting quotas for project 6e3d57c8abbd49e69c0caad57f7f9815. Resources: {'instances', 'cores', 'ram'} {{(pid=127869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:00:04.429908 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.quota [None req-07689e86-7f9d-4102-92a0-1c798c7bf92c tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Getting quotas for user 2206cb5005354ab4a716efb525c633e7 and project 6e3d57c8abbd49e69c0caad57f7f9815. Resources: {'instances', 'cores', 'ram'} {{(pid=127869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:00:04.441139 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-07689e86-7f9d-4102-92a0-1c798c7bf92c tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Going to run 1 instances... {{(pid=127869) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:00:04.443587 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-07689e86-7f9d-4102-92a0-1c798c7bf92c tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 0b573e91-3190-45e2-a716-049ad52cf885] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c32522f7-22a8-45d4-a51e-f17637def2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:00:04.596866 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-07689e86-7f9d-4102-92a0-1c798c7bf92c tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.665957 Aug 24 04:00:04.597509 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 471/935] 10.222.0.82 () {60 vars in 1147 bytes} [Wed Aug 24 04:00:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:00:04.608764 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ac5b6ac7-721a-43a0-85af-f59c787cb034 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:04.610027 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ac5b6ac7-721a-43a0-85af-f59c787cb034 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 0b573e91-3190-45e2-a716-049ad52cf885] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:04.612290 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:04.615987 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:04.670096 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-ac5b6ac7-721a-43a0-85af-f59c787cb034 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206cb5005354ab4a716efb525c633e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3d57c8abbd49e69c0caad57f7f9815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:04.679817 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ac5b6ac7-721a-43a0-85af-f59c787cb034 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "GET /compute/v2.1/servers/0b573e91-3190-45e2-a716-049ad52cf885" status: 200 len: 1219 microversion: 2.1 time: 0.075037 Aug 24 04:00:04.680729 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 465/936] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:04 2022] GET /compute/v2.1/servers/0b573e91-3190-45e2-a716-049ad52cf885 => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:05.706966 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-69f63761-b502-4330-8ff3-79f24aa09597 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:05.707704 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-69f63761-b502-4330-8ff3-79f24aa09597 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 0b573e91-3190-45e2-a716-049ad52cf885] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:05.714461 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-69f63761-b502-4330-8ff3-79f24aa09597 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:05.714966 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-69f63761-b502-4330-8ff3-79f24aa09597 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:05.715400 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-69f63761-b502-4330-8ff3-79f24aa09597 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:05.716121 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-69f63761-b502-4330-8ff3-79f24aa09597 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:05.716593 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-69f63761-b502-4330-8ff3-79f24aa09597 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:05.717014 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-69f63761-b502-4330-8ff3-79f24aa09597 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:05.806596 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-69f63761-b502-4330-8ff3-79f24aa09597 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206cb5005354ab4a716efb525c633e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3d57c8abbd49e69c0caad57f7f9815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:05.815347 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-69f63761-b502-4330-8ff3-79f24aa09597 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "GET /compute/v2.1/servers/0b573e91-3190-45e2-a716-049ad52cf885" status: 200 len: 1223 microversion: 2.1 time: 0.114265 Aug 24 04:00:05.816696 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 472/937] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:05 2022] GET /compute/v2.1/servers/0b573e91-3190-45e2-a716-049ad52cf885 => generated 1223 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:06.837294 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-11818c13-33b7-461c-8cf2-5dfc6913e3cc tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:06.837903 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-11818c13-33b7-461c-8cf2-5dfc6913e3cc tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 0b573e91-3190-45e2-a716-049ad52cf885] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:06.846721 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-11818c13-33b7-461c-8cf2-5dfc6913e3cc tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:06.847204 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-11818c13-33b7-461c-8cf2-5dfc6913e3cc tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:06.851788 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-11818c13-33b7-461c-8cf2-5dfc6913e3cc tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:06.851788 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-11818c13-33b7-461c-8cf2-5dfc6913e3cc tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:06.851788 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-11818c13-33b7-461c-8cf2-5dfc6913e3cc tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:06.851788 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-11818c13-33b7-461c-8cf2-5dfc6913e3cc tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:06.930287 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-11818c13-33b7-461c-8cf2-5dfc6913e3cc tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206cb5005354ab4a716efb525c633e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3d57c8abbd49e69c0caad57f7f9815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:06.938343 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-11818c13-33b7-461c-8cf2-5dfc6913e3cc tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "GET /compute/v2.1/servers/0b573e91-3190-45e2-a716-049ad52cf885" status: 200 len: 1271 microversion: 2.1 time: 0.104859 Aug 24 04:00:06.938983 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 466/938] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:06 2022] GET /compute/v2.1/servers/0b573e91-3190-45e2-a716-049ad52cf885 => generated 1271 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:07.964413 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-0149aeda-24f8-46d7-9262-c4c9754ae285 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:07.965660 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-0149aeda-24f8-46d7-9262-c4c9754ae285 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 0b573e91-3190-45e2-a716-049ad52cf885] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:07.972790 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0149aeda-24f8-46d7-9262-c4c9754ae285 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:07.973511 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0149aeda-24f8-46d7-9262-c4c9754ae285 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:07.974105 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0149aeda-24f8-46d7-9262-c4c9754ae285 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:07.977022 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0149aeda-24f8-46d7-9262-c4c9754ae285 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:07.977022 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0149aeda-24f8-46d7-9262-c4c9754ae285 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:07.977022 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0149aeda-24f8-46d7-9262-c4c9754ae285 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:08.193034 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-0149aeda-24f8-46d7-9262-c4c9754ae285 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206cb5005354ab4a716efb525c633e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3d57c8abbd49e69c0caad57f7f9815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:08.200883 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-0149aeda-24f8-46d7-9262-c4c9754ae285 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "GET /compute/v2.1/servers/0b573e91-3190-45e2-a716-049ad52cf885" status: 200 len: 1319 microversion: 2.1 time: 0.241966 Aug 24 04:00:08.201451 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 473/939] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:07 2022] GET /compute/v2.1/servers/0b573e91-3190-45e2-a716-049ad52cf885 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:09.057476 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-8fdfc37b-6c82-4159-a5a1-ca6ee39a52cd req-6f3a33a3-40a9-4931-b534-6977fca2ff69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b573e91-3190-45e2-a716-049ad52cf885", "tag": "51937bcb-e543-43c7-89fa-971ce6ded656"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:00:09.072982 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-8fdfc37b-6c82-4159-a5a1-ca6ee39a52cd req-6f3a33a3-40a9-4931-b534-6977fca2ff69 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:09.076059 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-8fdfc37b-6c82-4159-a5a1-ca6ee39a52cd req-6f3a33a3-40a9-4931-b534-6977fca2ff69 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:09.076059 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-8fdfc37b-6c82-4159-a5a1-ca6ee39a52cd req-6f3a33a3-40a9-4931-b534-6977fca2ff69 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:09.085881 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-8fdfc37b-6c82-4159-a5a1-ca6ee39a52cd req-6f3a33a3-40a9-4931-b534-6977fca2ff69 service nova] Creating event network-changed:51937bcb-e543-43c7-89fa-971ce6ded656 for instance 0b573e91-3190-45e2-a716-049ad52cf885 on hv-cinder-85426 Aug 24 04:00:09.091301 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-8fdfc37b-6c82-4159-a5a1-ca6ee39a52cd req-6f3a33a3-40a9-4931-b534-6977fca2ff69 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037425 Aug 24 04:00:09.091715 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 467/940] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 04:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:00:09.222963 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-18cd320b-db98-4805-8358-442234e9cdb5 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:09.223581 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-18cd320b-db98-4805-8358-442234e9cdb5 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 0b573e91-3190-45e2-a716-049ad52cf885] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:09.230247 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-18cd320b-db98-4805-8358-442234e9cdb5 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:09.230765 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-18cd320b-db98-4805-8358-442234e9cdb5 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:09.231203 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-18cd320b-db98-4805-8358-442234e9cdb5 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:09.231895 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-18cd320b-db98-4805-8358-442234e9cdb5 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:09.232369 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-18cd320b-db98-4805-8358-442234e9cdb5 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:09.232787 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-18cd320b-db98-4805-8358-442234e9cdb5 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:09.561688 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-18cd320b-db98-4805-8358-442234e9cdb5 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206cb5005354ab4a716efb525c633e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3d57c8abbd49e69c0caad57f7f9815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:09.570934 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-18cd320b-db98-4805-8358-442234e9cdb5 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "GET /compute/v2.1/servers/0b573e91-3190-45e2-a716-049ad52cf885" status: 200 len: 1319 microversion: 2.1 time: 0.352558 Aug 24 04:00:09.571590 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 474/941] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:09 2022] GET /compute/v2.1/servers/0b573e91-3190-45e2-a716-049ad52cf885 => generated 1319 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:10.598637 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ef5e99c8-1f85-4120-8f67-1b74f3f403e2 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:10.599377 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ef5e99c8-1f85-4120-8f67-1b74f3f403e2 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 0b573e91-3190-45e2-a716-049ad52cf885] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:10.606289 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ef5e99c8-1f85-4120-8f67-1b74f3f403e2 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:10.606804 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ef5e99c8-1f85-4120-8f67-1b74f3f403e2 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:10.607355 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ef5e99c8-1f85-4120-8f67-1b74f3f403e2 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:10.608047 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ef5e99c8-1f85-4120-8f67-1b74f3f403e2 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:10.608499 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ef5e99c8-1f85-4120-8f67-1b74f3f403e2 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:10.608917 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ef5e99c8-1f85-4120-8f67-1b74f3f403e2 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:10.760770 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-ef5e99c8-1f85-4120-8f67-1b74f3f403e2 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206cb5005354ab4a716efb525c633e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3d57c8abbd49e69c0caad57f7f9815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:10.769397 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ef5e99c8-1f85-4120-8f67-1b74f3f403e2 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "GET /compute/v2.1/servers/0b573e91-3190-45e2-a716-049ad52cf885" status: 200 len: 1319 microversion: 2.1 time: 0.177014 Aug 24 04:00:10.769975 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 468/942] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:10 2022] GET /compute/v2.1/servers/0b573e91-3190-45e2-a716-049ad52cf885 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:11.794601 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-99288b20-8454-4fb6-9382-04e4765f106f tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:11.795290 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-99288b20-8454-4fb6-9382-04e4765f106f tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 0b573e91-3190-45e2-a716-049ad52cf885] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:11.802355 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-99288b20-8454-4fb6-9382-04e4765f106f tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:11.802868 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-99288b20-8454-4fb6-9382-04e4765f106f tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:11.803302 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-99288b20-8454-4fb6-9382-04e4765f106f tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:11.803993 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-99288b20-8454-4fb6-9382-04e4765f106f tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:11.804442 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-99288b20-8454-4fb6-9382-04e4765f106f tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:11.804865 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-99288b20-8454-4fb6-9382-04e4765f106f tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:11.942370 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-99288b20-8454-4fb6-9382-04e4765f106f tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206cb5005354ab4a716efb525c633e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3d57c8abbd49e69c0caad57f7f9815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:11.950044 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-99288b20-8454-4fb6-9382-04e4765f106f tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "GET /compute/v2.1/servers/0b573e91-3190-45e2-a716-049ad52cf885" status: 200 len: 1319 microversion: 2.1 time: 0.159607 Aug 24 04:00:11.950634 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 475/943] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:11 2022] GET /compute/v2.1/servers/0b573e91-3190-45e2-a716-049ad52cf885 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:12.975105 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8c42c248-f2d5-49ee-8514-034834e04cab tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:12.977076 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8c42c248-f2d5-49ee-8514-034834e04cab tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 0b573e91-3190-45e2-a716-049ad52cf885] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:12.989493 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c42c248-f2d5-49ee-8514-034834e04cab tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:12.990312 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c42c248-f2d5-49ee-8514-034834e04cab tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:12.995525 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c42c248-f2d5-49ee-8514-034834e04cab tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:12.995525 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c42c248-f2d5-49ee-8514-034834e04cab tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:12.995525 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c42c248-f2d5-49ee-8514-034834e04cab tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:12.995525 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8c42c248-f2d5-49ee-8514-034834e04cab tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:13.141010 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-8c42c248-f2d5-49ee-8514-034834e04cab tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206cb5005354ab4a716efb525c633e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3d57c8abbd49e69c0caad57f7f9815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:13.149471 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8c42c248-f2d5-49ee-8514-034834e04cab tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "GET /compute/v2.1/servers/0b573e91-3190-45e2-a716-049ad52cf885" status: 200 len: 1319 microversion: 2.1 time: 0.181460 Aug 24 04:00:13.150105 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 469/944] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:12 2022] GET /compute/v2.1/servers/0b573e91-3190-45e2-a716-049ad52cf885 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:14.171127 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-421cfa8e-c8e2-4ca0-888b-209210b9e94b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:14.171737 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-421cfa8e-c8e2-4ca0-888b-209210b9e94b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 0b573e91-3190-45e2-a716-049ad52cf885] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:14.178337 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-421cfa8e-c8e2-4ca0-888b-209210b9e94b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:14.178915 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-421cfa8e-c8e2-4ca0-888b-209210b9e94b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:14.179350 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-421cfa8e-c8e2-4ca0-888b-209210b9e94b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:14.180032 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-421cfa8e-c8e2-4ca0-888b-209210b9e94b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:14.180482 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-421cfa8e-c8e2-4ca0-888b-209210b9e94b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:14.180898 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-421cfa8e-c8e2-4ca0-888b-209210b9e94b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:14.317529 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-421cfa8e-c8e2-4ca0-888b-209210b9e94b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206cb5005354ab4a716efb525c633e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3d57c8abbd49e69c0caad57f7f9815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:14.325162 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-421cfa8e-c8e2-4ca0-888b-209210b9e94b tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "GET /compute/v2.1/servers/0b573e91-3190-45e2-a716-049ad52cf885" status: 200 len: 1319 microversion: 2.1 time: 0.157917 Aug 24 04:00:14.326989 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 476/945] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:14 2022] GET /compute/v2.1/servers/0b573e91-3190-45e2-a716-049ad52cf885 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:15.243383 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-aabef807-2821-4013-b4fd-c6dab3e08a4f req-ca965d7d-31c2-40da-9fd2-67dbef1c5c14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b573e91-3190-45e2-a716-049ad52cf885", "name": "network-vif-plugged", "status": "completed", "tag": "51937bcb-e543-43c7-89fa-971ce6ded656"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:00:15.249749 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:15.256965 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-aabef807-2821-4013-b4fd-c6dab3e08a4f req-ca965d7d-31c2-40da-9fd2-67dbef1c5c14 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:15.257451 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-aabef807-2821-4013-b4fd-c6dab3e08a4f req-ca965d7d-31c2-40da-9fd2-67dbef1c5c14 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:15.257886 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-aabef807-2821-4013-b4fd-c6dab3e08a4f req-ca965d7d-31c2-40da-9fd2-67dbef1c5c14 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:15.269120 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-aabef807-2821-4013-b4fd-c6dab3e08a4f req-ca965d7d-31c2-40da-9fd2-67dbef1c5c14 service nova] Creating event network-vif-plugged:51937bcb-e543-43c7-89fa-971ce6ded656 for instance 0b573e91-3190-45e2-a716-049ad52cf885 on hv-cinder-85426 Aug 24 04:00:15.273942 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-aabef807-2821-4013-b4fd-c6dab3e08a4f req-ca965d7d-31c2-40da-9fd2-67dbef1c5c14 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034377 Aug 24 04:00:15.274551 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 470/946] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 04:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:00:15.348805 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-ab075919-7500-43fe-b420-6b589ebaf445 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:15.349511 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-ab075919-7500-43fe-b420-6b589ebaf445 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 0b573e91-3190-45e2-a716-049ad52cf885] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:15.352109 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell0:SELECT=2 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:15.352803 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell0:SELECT=6 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:15.359060 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ab075919-7500-43fe-b420-6b589ebaf445 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:15.359577 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ab075919-7500-43fe-b420-6b589ebaf445 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:15.361057 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ab075919-7500-43fe-b420-6b589ebaf445 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:15.361982 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ab075919-7500-43fe-b420-6b589ebaf445 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:15.362436 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ab075919-7500-43fe-b420-6b589ebaf445 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:15.362890 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ab075919-7500-43fe-b420-6b589ebaf445 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:15.500944 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-ab075919-7500-43fe-b420-6b589ebaf445 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206cb5005354ab4a716efb525c633e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3d57c8abbd49e69c0caad57f7f9815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:15.509258 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-ab075919-7500-43fe-b420-6b589ebaf445 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "GET /compute/v2.1/servers/0b573e91-3190-45e2-a716-049ad52cf885" status: 200 len: 1319 microversion: 2.1 time: 0.166502 Aug 24 04:00:15.509832 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 477/947] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:15 2022] GET /compute/v2.1/servers/0b573e91-3190-45e2-a716-049ad52cf885 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:16.540452 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b31b6dba-086d-4334-8856-d0bc72b31be9 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:16.541198 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b31b6dba-086d-4334-8856-d0bc72b31be9 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 0b573e91-3190-45e2-a716-049ad52cf885] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:16.548980 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b31b6dba-086d-4334-8856-d0bc72b31be9 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:16.549487 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b31b6dba-086d-4334-8856-d0bc72b31be9 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:16.549927 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b31b6dba-086d-4334-8856-d0bc72b31be9 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:16.550734 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b31b6dba-086d-4334-8856-d0bc72b31be9 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:16.551199 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b31b6dba-086d-4334-8856-d0bc72b31be9 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:16.556760 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b31b6dba-086d-4334-8856-d0bc72b31be9 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:16.692693 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-b31b6dba-086d-4334-8856-d0bc72b31be9 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206cb5005354ab4a716efb525c633e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3d57c8abbd49e69c0caad57f7f9815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:16.703044 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b31b6dba-086d-4334-8856-d0bc72b31be9 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "GET /compute/v2.1/servers/0b573e91-3190-45e2-a716-049ad52cf885" status: 200 len: 1319 microversion: 2.1 time: 0.168940 Aug 24 04:00:16.704180 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 471/948] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:16 2022] GET /compute/v2.1/servers/0b573e91-3190-45e2-a716-049ad52cf885 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:17.725587 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-c8cbdd0b-db56-4299-b9e4-c37124f29528 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:17.726162 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-c8cbdd0b-db56-4299-b9e4-c37124f29528 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 0b573e91-3190-45e2-a716-049ad52cf885] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:17.734007 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c8cbdd0b-db56-4299-b9e4-c37124f29528 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:17.734531 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c8cbdd0b-db56-4299-b9e4-c37124f29528 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:17.735010 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c8cbdd0b-db56-4299-b9e4-c37124f29528 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:17.736015 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c8cbdd0b-db56-4299-b9e4-c37124f29528 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:17.737055 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c8cbdd0b-db56-4299-b9e4-c37124f29528 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:17.738244 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c8cbdd0b-db56-4299-b9e4-c37124f29528 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:17.878902 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-c8cbdd0b-db56-4299-b9e4-c37124f29528 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206cb5005354ab4a716efb525c633e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3d57c8abbd49e69c0caad57f7f9815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:17.886833 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-c8cbdd0b-db56-4299-b9e4-c37124f29528 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "GET /compute/v2.1/servers/0b573e91-3190-45e2-a716-049ad52cf885" status: 200 len: 1507 microversion: 2.1 time: 0.166424 Aug 24 04:00:17.892184 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 478/949] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:17 2022] GET /compute/v2.1/servers/0b573e91-3190-45e2-a716-049ad52cf885 => generated 1507 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:17.915411 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e33d0d3b-e935-43b0-8196-93e1c4ff9b86 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a7f8c02-e37a-40a1-8498-3ff194eda21a", "device": "/dev/sdb"}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:00:17.917891 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e33d0d3b-e935-43b0-8196-93e1c4ff9b86 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 0b573e91-3190-45e2-a716-049ad52cf885] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:17.925433 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e33d0d3b-e935-43b0-8196-93e1c4ff9b86 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:17.931057 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e33d0d3b-e935-43b0-8196-93e1c4ff9b86 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:17.931057 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e33d0d3b-e935-43b0-8196-93e1c4ff9b86 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:17.931057 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e33d0d3b-e935-43b0-8196-93e1c4ff9b86 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:17.931057 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e33d0d3b-e935-43b0-8196-93e1c4ff9b86 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:17.931446 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e33d0d3b-e935-43b0-8196-93e1c4ff9b86 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:18.841739 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e33d0d3b-e935-43b0-8196-93e1c4ff9b86 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "POST /compute/v2.1/servers/0b573e91-3190-45e2-a716-049ad52cf885/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.930311 Aug 24 04:00:18.842410 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 472/950] 10.222.0.82 () {60 vars in 1323 bytes} [Wed Aug 24 04:00:17 2022] POST /compute/v2.1/servers/0b573e91-3190-45e2-a716-049ad52cf885/os-volume_attachments => generated 194 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:00:48.919731 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-ba9c159b-79c1-4eab-a473-d85bdd37f56d tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:48.920247 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-ba9c159b-79c1-4eab-a473-d85bdd37f56d tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 0b573e91-3190-45e2-a716-049ad52cf885] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:48.922186 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:48.922970 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell1:SELECT=44 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:48.927627 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ba9c159b-79c1-4eab-a473-d85bdd37f56d tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:48.928104 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ba9c159b-79c1-4eab-a473-d85bdd37f56d tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:48.928531 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ba9c159b-79c1-4eab-a473-d85bdd37f56d tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:48.929213 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ba9c159b-79c1-4eab-a473-d85bdd37f56d tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:48.929661 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ba9c159b-79c1-4eab-a473-d85bdd37f56d tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:48.930078 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ba9c159b-79c1-4eab-a473-d85bdd37f56d tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:49.017461 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.objects.instance [None req-ba9c159b-79c1-4eab-a473-d85bdd37f56d tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lazy-loading 'services' on Instance uuid 0b573e91-3190-45e2-a716-049ad52cf885 {{(pid=127869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:00:49.225550 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-ba9c159b-79c1-4eab-a473-d85bdd37f56d tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "DELETE /compute/v2.1/servers/0b573e91-3190-45e2-a716-049ad52cf885/os-volume_attachments/9a7f8c02-e37a-40a1-8498-3ff194eda21a" status: 202 len: 0 microversion: 2.1 time: 0.309936 Aug 24 04:00:49.230283 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 479/951] 10.222.0.82 () {58 vars in 1416 bytes} [Wed Aug 24 04:00:48 2022] DELETE /compute/v2.1/servers/0b573e91-3190-45e2-a716-049ad52cf885/os-volume_attachments/9a7f8c02-e37a-40a1-8498-3ff194eda21a => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:00:52.099595 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=18 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:52.100394 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:52.105147 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6e7b4bf2-13b8-4e79-80c2-8f626dc0983d tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-772338037", "imageRef": "c32522f7-22a8-45d4-a51e-f17637def2e1", "flavorRef": "452", "networks": [{"uuid": "ea1d8848-664e-4648-bdb6-2dc662f48fc5"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:00:52.159376 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-6e7b4bf2-13b8-4e79-80c2-8f626dc0983d tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] validate_networks() for [('ea1d8848-664e-4648-bdb6-2dc662f48fc5', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:00:52.467726 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-9bcec381-e9c7-4dc1-95b8-00639efb7f79 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:52.468407 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-9bcec381-e9c7-4dc1-95b8-00639efb7f79 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 0b573e91-3190-45e2-a716-049ad52cf885] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:52.475361 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9bcec381-e9c7-4dc1-95b8-00639efb7f79 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:52.475914 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9bcec381-e9c7-4dc1-95b8-00639efb7f79 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:52.476420 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9bcec381-e9c7-4dc1-95b8-00639efb7f79 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:52.477247 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9bcec381-e9c7-4dc1-95b8-00639efb7f79 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:52.477767 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9bcec381-e9c7-4dc1-95b8-00639efb7f79 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:52.478395 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9bcec381-e9c7-4dc1-95b8-00639efb7f79 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:52.504730 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-9bcec381-e9c7-4dc1-95b8-00639efb7f79 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 0b573e91-3190-45e2-a716-049ad52cf885] Going to try to terminate instance {{(pid=127869) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:00:52.532748 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-6e7b4bf2-13b8-4e79-80c2-8f626dc0983d tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:00:52.533250 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-6e7b4bf2-13b8-4e79-80c2-8f626dc0983d tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:00:52.533906 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-6e7b4bf2-13b8-4e79-80c2-8f626dc0983d tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:00:52.534350 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-6e7b4bf2-13b8-4e79-80c2-8f626dc0983d tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:00:52.534784 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-6e7b4bf2-13b8-4e79-80c2-8f626dc0983d tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:00:52.544254 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e7b4bf2-13b8-4e79-80c2-8f626dc0983d tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:52.547006 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e7b4bf2-13b8-4e79-80c2-8f626dc0983d tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:52.547006 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e7b4bf2-13b8-4e79-80c2-8f626dc0983d tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:52.547006 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e7b4bf2-13b8-4e79-80c2-8f626dc0983d tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:52.547006 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e7b4bf2-13b8-4e79-80c2-8f626dc0983d tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:52.547388 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6e7b4bf2-13b8-4e79-80c2-8f626dc0983d tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:52.563311 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.quota [None req-6e7b4bf2-13b8-4e79-80c2-8f626dc0983d tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Getting quotas for project 3b064eb9c6944e11b79e161e4df5205a. Resources: {'instances', 'cores', 'ram'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:00:52.567362 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.quota [None req-6e7b4bf2-13b8-4e79-80c2-8f626dc0983d tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Getting quotas for user 8cfff1e957f1464dbee571606dc39624 and project 3b064eb9c6944e11b79e161e4df5205a. Resources: {'instances', 'cores', 'ram'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:00:52.579541 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6e7b4bf2-13b8-4e79-80c2-8f626dc0983d tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:00:52.582008 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6e7b4bf2-13b8-4e79-80c2-8f626dc0983d tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 37faf4af-c834-40c2-9548-5e38d79f1514] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c32522f7-22a8-45d4-a51e-f17637def2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:00:52.697887 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6e7b4bf2-13b8-4e79-80c2-8f626dc0983d tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.599610 Aug 24 04:00:52.698907 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 473/952] 10.222.0.82 () {60 vars in 1147 bytes} [Wed Aug 24 04:00:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:00:52.710929 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b5dea985-39b0-4f84-8107-b6dfaf4aacf6 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:52.711550 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b5dea985-39b0-4f84-8107-b6dfaf4aacf6 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 37faf4af-c834-40c2-9548-5e38d79f1514] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:52.770745 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-b5dea985-39b0-4f84-8107-b6dfaf4aacf6 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfff1e957f1464dbee571606dc39624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b064eb9c6944e11b79e161e4df5205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:52.785139 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b5dea985-39b0-4f84-8107-b6dfaf4aacf6 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514" status: 200 len: 1213 microversion: 2.1 time: 0.072667 Aug 24 04:00:52.785139 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 474/953] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:52 2022] GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514 => generated 1213 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:00:53.035933 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-9bcec381-e9c7-4dc1-95b8-00639efb7f79 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "DELETE /compute/v2.1/servers/0b573e91-3190-45e2-a716-049ad52cf885" status: 204 len: 0 microversion: 2.1 time: 0.573065 Aug 24 04:00:53.036444 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 480/954] 10.222.0.82 () {58 vars in 1239 bytes} [Wed Aug 24 04:00:52 2022] DELETE /compute/v2.1/servers/0b573e91-3190-45e2-a716-049ad52cf885 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:53.045019 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e6c29d49-7027-43f7-92c3-962e14f07bf4 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:53.045643 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e6c29d49-7027-43f7-92c3-962e14f07bf4 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 0b573e91-3190-45e2-a716-049ad52cf885] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:53.052631 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e6c29d49-7027-43f7-92c3-962e14f07bf4 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:53.053117 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e6c29d49-7027-43f7-92c3-962e14f07bf4 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:53.053555 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e6c29d49-7027-43f7-92c3-962e14f07bf4 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:53.054293 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e6c29d49-7027-43f7-92c3-962e14f07bf4 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:53.054783 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e6c29d49-7027-43f7-92c3-962e14f07bf4 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:53.055210 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e6c29d49-7027-43f7-92c3-962e14f07bf4 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:53.195100 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-e6c29d49-7027-43f7-92c3-962e14f07bf4 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206cb5005354ab4a716efb525c633e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3d57c8abbd49e69c0caad57f7f9815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:53.200230 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e6c29d49-7027-43f7-92c3-962e14f07bf4 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "GET /compute/v2.1/servers/0b573e91-3190-45e2-a716-049ad52cf885" status: 200 len: 1513 microversion: 2.1 time: 0.159335 Aug 24 04:00:53.200809 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 475/955] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:53 2022] GET /compute/v2.1/servers/0b573e91-3190-45e2-a716-049ad52cf885 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:53.800821 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-09429ca7-8766-400f-849c-4ba43ebb33f2 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:53.801412 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-09429ca7-8766-400f-849c-4ba43ebb33f2 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 37faf4af-c834-40c2-9548-5e38d79f1514] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:53.856995 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-09429ca7-8766-400f-849c-4ba43ebb33f2 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfff1e957f1464dbee571606dc39624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b064eb9c6944e11b79e161e4df5205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:53.864532 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-09429ca7-8766-400f-849c-4ba43ebb33f2 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514" status: 200 len: 1213 microversion: 2.1 time: 0.068102 Aug 24 04:00:53.865081 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 481/956] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:53 2022] GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514 => generated 1213 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:54.220721 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4f4b87c8-6578-4042-b357-c6609fa7dbae tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:54.221329 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4f4b87c8-6578-4042-b357-c6609fa7dbae tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 0b573e91-3190-45e2-a716-049ad52cf885] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:54.233286 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f4b87c8-6578-4042-b357-c6609fa7dbae tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:54.233286 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f4b87c8-6578-4042-b357-c6609fa7dbae tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:54.233286 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f4b87c8-6578-4042-b357-c6609fa7dbae tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:54.233286 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f4b87c8-6578-4042-b357-c6609fa7dbae tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:54.233657 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f4b87c8-6578-4042-b357-c6609fa7dbae tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:54.233657 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f4b87c8-6578-4042-b357-c6609fa7dbae tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:54.369715 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-4f4b87c8-6578-4042-b357-c6609fa7dbae tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206cb5005354ab4a716efb525c633e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3d57c8abbd49e69c0caad57f7f9815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:54.374063 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4f4b87c8-6578-4042-b357-c6609fa7dbae tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "GET /compute/v2.1/servers/0b573e91-3190-45e2-a716-049ad52cf885" status: 200 len: 1513 microversion: 2.1 time: 0.157349 Aug 24 04:00:54.374679 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 476/957] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:54 2022] GET /compute/v2.1/servers/0b573e91-3190-45e2-a716-049ad52cf885 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:54.887022 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-ca12d8ce-89b7-4375-ac25-001436f09bb6 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:54.887637 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-ca12d8ce-89b7-4375-ac25-001436f09bb6 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 37faf4af-c834-40c2-9548-5e38d79f1514] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:54.894199 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ca12d8ce-89b7-4375-ac25-001436f09bb6 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:54.894730 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ca12d8ce-89b7-4375-ac25-001436f09bb6 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:54.895170 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ca12d8ce-89b7-4375-ac25-001436f09bb6 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:54.895967 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ca12d8ce-89b7-4375-ac25-001436f09bb6 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:54.896318 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ca12d8ce-89b7-4375-ac25-001436f09bb6 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:54.896739 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ca12d8ce-89b7-4375-ac25-001436f09bb6 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:54.963236 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-ca12d8ce-89b7-4375-ac25-001436f09bb6 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfff1e957f1464dbee571606dc39624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b064eb9c6944e11b79e161e4df5205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:54.972636 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-ca12d8ce-89b7-4375-ac25-001436f09bb6 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514" status: 200 len: 1217 microversion: 2.1 time: 0.090603 Aug 24 04:00:54.973206 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 482/958] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:54 2022] GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514 => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:55.401282 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-45438ce6-b84a-429a-bb4e-716d4aa5b822 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:55.402129 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-45438ce6-b84a-429a-bb4e-716d4aa5b822 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 0b573e91-3190-45e2-a716-049ad52cf885] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:55.413174 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-45438ce6-b84a-429a-bb4e-716d4aa5b822 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:55.414013 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-45438ce6-b84a-429a-bb4e-716d4aa5b822 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:55.414711 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-45438ce6-b84a-429a-bb4e-716d4aa5b822 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:55.415853 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-45438ce6-b84a-429a-bb4e-716d4aa5b822 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:55.417250 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-45438ce6-b84a-429a-bb4e-716d4aa5b822 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:55.417887 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-45438ce6-b84a-429a-bb4e-716d4aa5b822 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:55.649464 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-0f5b441c-ed7b-434c-9868-791ea06eae5d req-c5aa89d4-cfac-41b3-915a-e15c98e98808 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b573e91-3190-45e2-a716-049ad52cf885", "name": "network-vif-deleted", "tag": "51937bcb-e543-43c7-89fa-971ce6ded656"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:00:55.671817 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-0f5b441c-ed7b-434c-9868-791ea06eae5d req-c5aa89d4-cfac-41b3-915a-e15c98e98808 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:55.672395 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-0f5b441c-ed7b-434c-9868-791ea06eae5d req-c5aa89d4-cfac-41b3-915a-e15c98e98808 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:55.672896 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-0f5b441c-ed7b-434c-9868-791ea06eae5d req-c5aa89d4-cfac-41b3-915a-e15c98e98808 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:55.689141 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-0f5b441c-ed7b-434c-9868-791ea06eae5d req-c5aa89d4-cfac-41b3-915a-e15c98e98808 service nova] Creating event network-vif-deleted:51937bcb-e543-43c7-89fa-971ce6ded656 for instance 0b573e91-3190-45e2-a716-049ad52cf885 on hv-cinder-85426 Aug 24 04:00:55.694257 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-0f5b441c-ed7b-434c-9868-791ea06eae5d req-c5aa89d4-cfac-41b3-915a-e15c98e98808 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050728 Aug 24 04:00:55.695267 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 483/959] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 04:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:00:55.910377 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-45438ce6-b84a-429a-bb4e-716d4aa5b822 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206cb5005354ab4a716efb525c633e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3d57c8abbd49e69c0caad57f7f9815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:55.916970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-45438ce6-b84a-429a-bb4e-716d4aa5b822 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "GET /compute/v2.1/servers/0b573e91-3190-45e2-a716-049ad52cf885" status: 200 len: 1513 microversion: 2.1 time: 0.523906 Aug 24 04:00:55.917995 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 477/960] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:55 2022] GET /compute/v2.1/servers/0b573e91-3190-45e2-a716-049ad52cf885 => generated 1513 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:55.994829 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-e4141505-10b2-4962-a444-9db325341d12 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:55.996835 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-e4141505-10b2-4962-a444-9db325341d12 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 37faf4af-c834-40c2-9548-5e38d79f1514] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:56.004688 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e4141505-10b2-4962-a444-9db325341d12 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:56.006789 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e4141505-10b2-4962-a444-9db325341d12 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:56.006789 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e4141505-10b2-4962-a444-9db325341d12 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:56.007205 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e4141505-10b2-4962-a444-9db325341d12 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:56.007900 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e4141505-10b2-4962-a444-9db325341d12 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:56.008331 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e4141505-10b2-4962-a444-9db325341d12 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:56.337500 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-e4141505-10b2-4962-a444-9db325341d12 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfff1e957f1464dbee571606dc39624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b064eb9c6944e11b79e161e4df5205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:56.349676 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-e4141505-10b2-4962-a444-9db325341d12 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514" status: 200 len: 1265 microversion: 2.1 time: 0.357380 Aug 24 04:00:56.349676 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 484/961] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:55 2022] GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514 => generated 1265 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:56.958927 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0ad77b8f-0142-4ae5-bf25-7b42d7febc5e tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:56.958927 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0ad77b8f-0142-4ae5-bf25-7b42d7febc5e tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 0b573e91-3190-45e2-a716-049ad52cf885] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:56.974446 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0ad77b8f-0142-4ae5-bf25-7b42d7febc5e tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:56.978361 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0ad77b8f-0142-4ae5-bf25-7b42d7febc5e tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:56.979782 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0ad77b8f-0142-4ae5-bf25-7b42d7febc5e tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:56.980348 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0ad77b8f-0142-4ae5-bf25-7b42d7febc5e tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:56.981489 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0ad77b8f-0142-4ae5-bf25-7b42d7febc5e tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:56.981923 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0ad77b8f-0142-4ae5-bf25-7b42d7febc5e tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:57.016157 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0ad77b8f-0142-4ae5-bf25-7b42d7febc5e tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:57.016905 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0ad77b8f-0142-4ae5-bf25-7b42d7febc5e tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:57.017448 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0ad77b8f-0142-4ae5-bf25-7b42d7febc5e tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:57.018704 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-0ad77b8f-0142-4ae5-bf25-7b42d7febc5e tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lazy-loading 'fault' on Instance uuid 0b573e91-3190-45e2-a716-049ad52cf885 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:00:57.074346 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-0ad77b8f-0142-4ae5-bf25-7b42d7febc5e tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206cb5005354ab4a716efb525c633e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3d57c8abbd49e69c0caad57f7f9815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:57.083243 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0ad77b8f-0142-4ae5-bf25-7b42d7febc5e tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "GET /compute/v2.1/servers/0b573e91-3190-45e2-a716-049ad52cf885" status: 200 len: 1309 microversion: 2.1 time: 0.146866 Aug 24 04:00:57.083967 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 478/962] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:56 2022] GET /compute/v2.1/servers/0b573e91-3190-45e2-a716-049ad52cf885 => generated 1309 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:57.369550 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-03170e6f-8d1e-4c66-927f-64d591aa76e6 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:57.369550 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-03170e6f-8d1e-4c66-927f-64d591aa76e6 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 37faf4af-c834-40c2-9548-5e38d79f1514] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:57.377010 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-03170e6f-8d1e-4c66-927f-64d591aa76e6 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:57.377827 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-03170e6f-8d1e-4c66-927f-64d591aa76e6 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:57.378497 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-03170e6f-8d1e-4c66-927f-64d591aa76e6 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:57.379294 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-03170e6f-8d1e-4c66-927f-64d591aa76e6 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:57.379837 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-03170e6f-8d1e-4c66-927f-64d591aa76e6 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:57.380456 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-03170e6f-8d1e-4c66-927f-64d591aa76e6 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:57.464613 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-03170e6f-8d1e-4c66-927f-64d591aa76e6 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfff1e957f1464dbee571606dc39624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b064eb9c6944e11b79e161e4df5205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:57.475970 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-03170e6f-8d1e-4c66-927f-64d591aa76e6 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514" status: 200 len: 1271 microversion: 2.1 time: 0.110600 Aug 24 04:00:57.476698 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 485/963] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:57 2022] GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514 => generated 1271 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:58.106762 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c1acdd98-660b-413c-90ad-79683a55ef75 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:58.107940 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c1acdd98-660b-413c-90ad-79683a55ef75 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] [instance: 0b573e91-3190-45e2-a716-049ad52cf885] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:58.114413 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c1acdd98-660b-413c-90ad-79683a55ef75 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:58.114944 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c1acdd98-660b-413c-90ad-79683a55ef75 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:58.115385 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c1acdd98-660b-413c-90ad-79683a55ef75 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:58.116092 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c1acdd98-660b-413c-90ad-79683a55ef75 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:58.116552 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c1acdd98-660b-413c-90ad-79683a55ef75 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:58.116977 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c1acdd98-660b-413c-90ad-79683a55ef75 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:58.132754 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-c1acdd98-660b-413c-90ad-79683a55ef75 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] HTTP exception thrown: Instance 0b573e91-3190-45e2-a716-049ad52cf885 could not be found. Aug 24 04:00:58.134423 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c1acdd98-660b-413c-90ad-79683a55ef75 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Request method failure captured: Aug 24 04:00:58.134423 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/0b573e91-3190-45e2-a716-049ad52cf885 HTTP/1.1 Aug 24 04:00:58.134423 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept: application/json Aug 24 04:00:58.134423 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept-Encoding: identity Aug 24 04:00:58.134423 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Connection: close Aug 24 04:00:58.134423 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Length: 0 Aug 24 04:00:58.134423 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Type: application/json Aug 24 04:00:58.134423 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Host: 10.222.0.82 Aug 24 04:00:58.134423 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Openstack-System-Scope: None Aug 24 04:00:58.134423 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.11 Aug 24 04:00:58.134423 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Auth-Token: gAAAAABjBaHteSKONEGDb0C5U4IGCoqZCVDQ9kvVP-g2i_ckkrJKz0LZ3bSQrc2f2zZv8bw-y1aGNHHXTy3lVY4wa-g-UWfeA7BOavmb7iBYUvTmXwj1fUl-GV4drti1VgYqVp3orB9sBT5aKCMSc66ZlHUnUKo3exEtA6eBKVYgGR0oFDnSnqc Aug 24 04:00:58.134423 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Id: None Aug 24 04:00:58.134423 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Name: None Aug 24 04:00:58.134423 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Identity-Status: Confirmed Aug 24 04:00:58.134423 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Is-Admin-Project: True Aug 24 04:00:58.134423 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Id: default Aug 24 04:00:58.134423 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Name: Default Aug 24 04:00:58.134423 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Id: 6e3d57c8abbd49e69c0caad57f7f9815 Aug 24 04:00:58.134423 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1580980535 Aug 24 04:00:58.134423 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Role: member,reader Aug 24 04:00:58.134423 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Roles: member,reader Aug 24 04:00:58.136024 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/6e3d57c8abbd49e69c0caad57f7f9815"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/6e3d57c8abbd49e69c0caad57f7f9815"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/6e3d57c8abbd49e69c0caad57f7f9815"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_6e3d57c8abbd49e69c0caad57f7f9815", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 04:00:58.136024 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant: tempest-VolumesSnapshotTestJSON-1580980535 Aug 24 04:00:58.136024 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Id: 6e3d57c8abbd49e69c0caad57f7f9815 Aug 24 04:00:58.136024 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1580980535 Aug 24 04:00:58.136024 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User: tempest-VolumesSnapshotTestJSON-1580980535-project Aug 24 04:00:58.136024 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Id: default Aug 24 04:00:58.136024 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Name: Default Aug 24 04:00:58.136024 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Id: 2206cb5005354ab4a716efb525c633e7 Aug 24 04:00:58.136024 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Name: tempest-VolumesSnapshotTestJSON-1580980535-project Aug 24 04:00:58.136024 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: method: > Aug 24 04:00:58.136024 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: exception: Instance 0b573e91-3190-45e2-a716-049ad52cf885 could not be found. Aug 24 04:00:58.136024 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: action_args: {'id': '0b573e91-3190-45e2-a716-049ad52cf885'} Aug 24 04:00:58.136855 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:00:58.136855 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:58.136855 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:00:58.136855 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:00:58.136855 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:00:58.136855 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:00:58.136855 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:00:58.136855 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:00:58.136855 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:00:58.136855 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:00:58.136855 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b573e91-3190-45e2-a716-049ad52cf885 could not be found. Aug 24 04:00:58.136855 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 04:00:58.136855 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:00:58.136855 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 04:00:58.136855 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:58.136855 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:00:58.136855 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:00:58.136855 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:00:58.136855 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:00:58.136855 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:00:58.138203 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:00:58.138203 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:00:58.138203 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:00:58.138203 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:00:58.138203 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:00:58.138203 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:00:58.138203 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:00:58.138203 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b573e91-3190-45e2-a716-049ad52cf885 could not be found. Aug 24 04:00:58.138203 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 04:00:58.138203 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:00:58.138203 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 04:00:58.138203 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:58.138203 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:00:58.138203 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:00:58.138203 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:00:58.138203 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:00:58.138203 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b573e91-3190-45e2-a716-049ad52cf885 could not be found. Aug 24 04:00:58.138203 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 04:00:58.141140 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c1acdd98-660b-413c-90ad-79683a55ef75 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] Returning 404 to user: Instance 0b573e91-3190-45e2-a716-049ad52cf885 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:00:58.141140 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c1acdd98-660b-413c-90ad-79683a55ef75 tempest-VolumesSnapshotTestJSON-1580980535 tempest-VolumesSnapshotTestJSON-1580980535-project] 10.222.0.82 "GET /compute/v2.1/servers/0b573e91-3190-45e2-a716-049ad52cf885" status: 404 len: 111 microversion: 2.1 time: 0.034689 Aug 24 04:00:58.141140 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 479/964] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:58 2022] GET /compute/v2.1/servers/0b573e91-3190-45e2-a716-049ad52cf885 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:00:58.497648 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-0bd47b02-b524-4d0c-a7e7-142f729a6d7c tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:58.503260 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-0bd47b02-b524-4d0c-a7e7-142f729a6d7c tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 37faf4af-c834-40c2-9548-5e38d79f1514] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:58.505585 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0bd47b02-b524-4d0c-a7e7-142f729a6d7c tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:58.506142 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0bd47b02-b524-4d0c-a7e7-142f729a6d7c tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:58.506697 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0bd47b02-b524-4d0c-a7e7-142f729a6d7c tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:58.507477 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0bd47b02-b524-4d0c-a7e7-142f729a6d7c tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:58.508001 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0bd47b02-b524-4d0c-a7e7-142f729a6d7c tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:58.508537 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0bd47b02-b524-4d0c-a7e7-142f729a6d7c tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:58.675026 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-0774a992-a957-4b45-8b21-f9f517b02a7f req-e3d0231d-a1ac-4bfa-9999-51ccf04fa69c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37faf4af-c834-40c2-9548-5e38d79f1514", "tag": "7eb7cbed-379c-4476-8174-b713534bb784"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:00:58.679629 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-0bd47b02-b524-4d0c-a7e7-142f729a6d7c tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfff1e957f1464dbee571606dc39624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b064eb9c6944e11b79e161e4df5205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:58.693476 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-0bd47b02-b524-4d0c-a7e7-142f729a6d7c tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514" status: 200 len: 1313 microversion: 2.1 time: 0.200017 Aug 24 04:00:58.694333 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 486/965] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:58 2022] GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514 => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:58.694676 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-0774a992-a957-4b45-8b21-f9f517b02a7f req-e3d0231d-a1ac-4bfa-9999-51ccf04fa69c service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:58.695262 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-0774a992-a957-4b45-8b21-f9f517b02a7f req-e3d0231d-a1ac-4bfa-9999-51ccf04fa69c service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:58.695693 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-0774a992-a957-4b45-8b21-f9f517b02a7f req-e3d0231d-a1ac-4bfa-9999-51ccf04fa69c service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:58.710797 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-0774a992-a957-4b45-8b21-f9f517b02a7f req-e3d0231d-a1ac-4bfa-9999-51ccf04fa69c service nova] Creating event network-changed:7eb7cbed-379c-4476-8174-b713534bb784 for instance 37faf4af-c834-40c2-9548-5e38d79f1514 on hv-cinder-85426 Aug 24 04:00:58.717005 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-0774a992-a957-4b45-8b21-f9f517b02a7f req-e3d0231d-a1ac-4bfa-9999-51ccf04fa69c service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045572 Aug 24 04:00:58.718309 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 480/966] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 04:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:00:59.716229 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-12074817-8863-452c-b5f6-17fb8a29b215 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:59.717234 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-12074817-8863-452c-b5f6-17fb8a29b215 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 37faf4af-c834-40c2-9548-5e38d79f1514] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:59.725806 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-12074817-8863-452c-b5f6-17fb8a29b215 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:59.726698 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-12074817-8863-452c-b5f6-17fb8a29b215 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:59.727446 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-12074817-8863-452c-b5f6-17fb8a29b215 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:59.729303 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-12074817-8863-452c-b5f6-17fb8a29b215 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:59.730403 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-12074817-8863-452c-b5f6-17fb8a29b215 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:59.731305 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-12074817-8863-452c-b5f6-17fb8a29b215 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:59.887755 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-12074817-8863-452c-b5f6-17fb8a29b215 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfff1e957f1464dbee571606dc39624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b064eb9c6944e11b79e161e4df5205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:59.895386 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-12074817-8863-452c-b5f6-17fb8a29b215 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514" status: 200 len: 1313 microversion: 2.1 time: 0.183789 Aug 24 04:00:59.895945 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 487/967] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:59 2022] GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:00.917176 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-08e18599-51bd-4491-8940-f51074be8c45 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:00.917899 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-08e18599-51bd-4491-8940-f51074be8c45 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 37faf4af-c834-40c2-9548-5e38d79f1514] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:00.924526 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-08e18599-51bd-4491-8940-f51074be8c45 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:00.925008 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-08e18599-51bd-4491-8940-f51074be8c45 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:00.925444 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-08e18599-51bd-4491-8940-f51074be8c45 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:00.926138 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-08e18599-51bd-4491-8940-f51074be8c45 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:00.926625 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-08e18599-51bd-4491-8940-f51074be8c45 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:00.927053 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-08e18599-51bd-4491-8940-f51074be8c45 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:01.064130 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-08e18599-51bd-4491-8940-f51074be8c45 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfff1e957f1464dbee571606dc39624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b064eb9c6944e11b79e161e4df5205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:01.071809 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-08e18599-51bd-4491-8940-f51074be8c45 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514" status: 200 len: 1313 microversion: 2.1 time: 0.159277 Aug 24 04:01:01.073426 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 481/968] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:00 2022] GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:02.093810 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-488b16b1-99a0-4840-9bf4-d02558b8c872 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:02.094355 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-488b16b1-99a0-4840-9bf4-d02558b8c872 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 37faf4af-c834-40c2-9548-5e38d79f1514] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:02.100933 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-488b16b1-99a0-4840-9bf4-d02558b8c872 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:02.101415 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-488b16b1-99a0-4840-9bf4-d02558b8c872 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:02.101850 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-488b16b1-99a0-4840-9bf4-d02558b8c872 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:02.102566 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-488b16b1-99a0-4840-9bf4-d02558b8c872 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:02.103023 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-488b16b1-99a0-4840-9bf4-d02558b8c872 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:02.103443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-488b16b1-99a0-4840-9bf4-d02558b8c872 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:02.235628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-488b16b1-99a0-4840-9bf4-d02558b8c872 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfff1e957f1464dbee571606dc39624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b064eb9c6944e11b79e161e4df5205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:02.243566 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-488b16b1-99a0-4840-9bf4-d02558b8c872 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514" status: 200 len: 1313 microversion: 2.1 time: 0.154346 Aug 24 04:01:02.244527 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 488/969] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:02 2022] GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:03.264771 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-abf46d48-76a3-4182-b920-eb895073d862 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:03.265382 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-abf46d48-76a3-4182-b920-eb895073d862 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 37faf4af-c834-40c2-9548-5e38d79f1514] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:03.267893 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:03.268600 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=8 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:03.274557 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-abf46d48-76a3-4182-b920-eb895073d862 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:03.274557 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-abf46d48-76a3-4182-b920-eb895073d862 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:03.274557 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-abf46d48-76a3-4182-b920-eb895073d862 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:03.275059 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-abf46d48-76a3-4182-b920-eb895073d862 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:03.275418 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-abf46d48-76a3-4182-b920-eb895073d862 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:03.275838 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-abf46d48-76a3-4182-b920-eb895073d862 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:03.411475 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-abf46d48-76a3-4182-b920-eb895073d862 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfff1e957f1464dbee571606dc39624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b064eb9c6944e11b79e161e4df5205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:03.420493 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-abf46d48-76a3-4182-b920-eb895073d862 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514" status: 200 len: 1313 microversion: 2.1 time: 0.159693 Aug 24 04:01:03.421081 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 482/970] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:03 2022] GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:01:04.441353 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-b19dbee6-ca1d-45f2-9634-202a0e6b92d9 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:04.441991 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-b19dbee6-ca1d-45f2-9634-202a0e6b92d9 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 37faf4af-c834-40c2-9548-5e38d79f1514] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:04.444615 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell0:SELECT=2 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:04.449589 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b19dbee6-ca1d-45f2-9634-202a0e6b92d9 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:04.450078 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b19dbee6-ca1d-45f2-9634-202a0e6b92d9 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:04.450546 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b19dbee6-ca1d-45f2-9634-202a0e6b92d9 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:04.451319 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b19dbee6-ca1d-45f2-9634-202a0e6b92d9 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:04.451770 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b19dbee6-ca1d-45f2-9634-202a0e6b92d9 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:04.452188 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b19dbee6-ca1d-45f2-9634-202a0e6b92d9 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:04.589529 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-b19dbee6-ca1d-45f2-9634-202a0e6b92d9 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfff1e957f1464dbee571606dc39624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b064eb9c6944e11b79e161e4df5205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:04.597091 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-b19dbee6-ca1d-45f2-9634-202a0e6b92d9 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514" status: 200 len: 1313 microversion: 2.1 time: 0.159682 Aug 24 04:01:04.597674 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 489/971] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:04 2022] GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:05.530579 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-85e9a40e-bbc6-4a6d-8b99-3275aa5c47ae req-b65d05bd-27ca-400c-b8ea-20ed3eff53fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37faf4af-c834-40c2-9548-5e38d79f1514", "name": "network-vif-plugged", "status": "completed", "tag": "7eb7cbed-379c-4476-8174-b713534bb784"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:01:05.540483 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-85e9a40e-bbc6-4a6d-8b99-3275aa5c47ae req-b65d05bd-27ca-400c-b8ea-20ed3eff53fc service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:05.540947 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-85e9a40e-bbc6-4a6d-8b99-3275aa5c47ae req-b65d05bd-27ca-400c-b8ea-20ed3eff53fc service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:05.541374 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-85e9a40e-bbc6-4a6d-8b99-3275aa5c47ae req-b65d05bd-27ca-400c-b8ea-20ed3eff53fc service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:05.553047 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-85e9a40e-bbc6-4a6d-8b99-3275aa5c47ae req-b65d05bd-27ca-400c-b8ea-20ed3eff53fc service nova] Creating event network-vif-plugged:7eb7cbed-379c-4476-8174-b713534bb784 for instance 37faf4af-c834-40c2-9548-5e38d79f1514 on hv-cinder-85426 Aug 24 04:01:05.557836 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-85e9a40e-bbc6-4a6d-8b99-3275aa5c47ae req-b65d05bd-27ca-400c-b8ea-20ed3eff53fc service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031750 Aug 24 04:01:05.561471 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 483/972] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 04:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:01:05.618739 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-4ec35444-7b2d-45a7-978f-55c47ced856f tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:05.619354 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-4ec35444-7b2d-45a7-978f-55c47ced856f tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 37faf4af-c834-40c2-9548-5e38d79f1514] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:05.628248 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4ec35444-7b2d-45a7-978f-55c47ced856f tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:05.628807 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4ec35444-7b2d-45a7-978f-55c47ced856f tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:05.629491 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4ec35444-7b2d-45a7-978f-55c47ced856f tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:05.630223 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4ec35444-7b2d-45a7-978f-55c47ced856f tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:05.630710 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4ec35444-7b2d-45a7-978f-55c47ced856f tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:05.631138 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4ec35444-7b2d-45a7-978f-55c47ced856f tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:05.773931 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-4ec35444-7b2d-45a7-978f-55c47ced856f tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfff1e957f1464dbee571606dc39624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b064eb9c6944e11b79e161e4df5205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:05.783016 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-4ec35444-7b2d-45a7-978f-55c47ced856f tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514" status: 200 len: 1313 microversion: 2.1 time: 0.168455 Aug 24 04:01:05.783628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 490/973] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:05 2022] GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:06.806284 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5f9c4b4d-663c-401b-9179-151e3e0ca6c9 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:06.806950 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5f9c4b4d-663c-401b-9179-151e3e0ca6c9 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 37faf4af-c834-40c2-9548-5e38d79f1514] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:06.813775 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5f9c4b4d-663c-401b-9179-151e3e0ca6c9 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:06.814292 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5f9c4b4d-663c-401b-9179-151e3e0ca6c9 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:06.814722 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5f9c4b4d-663c-401b-9179-151e3e0ca6c9 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:06.815411 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5f9c4b4d-663c-401b-9179-151e3e0ca6c9 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:06.815865 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5f9c4b4d-663c-401b-9179-151e3e0ca6c9 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:06.816286 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5f9c4b4d-663c-401b-9179-151e3e0ca6c9 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:06.951744 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-5f9c4b4d-663c-401b-9179-151e3e0ca6c9 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfff1e957f1464dbee571606dc39624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b064eb9c6944e11b79e161e4df5205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:06.959426 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5f9c4b4d-663c-401b-9179-151e3e0ca6c9 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514" status: 200 len: 1313 microversion: 2.1 time: 0.158528 Aug 24 04:01:06.959992 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 484/974] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:06 2022] GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:07.981143 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-bd454f50-aeb8-450f-98a6-59424d465bd9 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:07.981727 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-bd454f50-aeb8-450f-98a6-59424d465bd9 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 37faf4af-c834-40c2-9548-5e38d79f1514] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:07.988141 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bd454f50-aeb8-450f-98a6-59424d465bd9 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:07.988617 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bd454f50-aeb8-450f-98a6-59424d465bd9 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:07.989039 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bd454f50-aeb8-450f-98a6-59424d465bd9 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:07.991113 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bd454f50-aeb8-450f-98a6-59424d465bd9 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:07.991113 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bd454f50-aeb8-450f-98a6-59424d465bd9 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:07.991113 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bd454f50-aeb8-450f-98a6-59424d465bd9 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:08.121226 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-bd454f50-aeb8-450f-98a6-59424d465bd9 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfff1e957f1464dbee571606dc39624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b064eb9c6944e11b79e161e4df5205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:08.129176 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-bd454f50-aeb8-450f-98a6-59424d465bd9 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514" status: 200 len: 1313 microversion: 2.1 time: 0.151872 Aug 24 04:01:08.129731 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 491/975] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:07 2022] GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:09.150545 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-66c498fe-7b2a-4ac2-9c7d-2c97c8988ea7 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:09.151066 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-66c498fe-7b2a-4ac2-9c7d-2c97c8988ea7 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 37faf4af-c834-40c2-9548-5e38d79f1514] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:09.158628 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-66c498fe-7b2a-4ac2-9c7d-2c97c8988ea7 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:09.159106 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-66c498fe-7b2a-4ac2-9c7d-2c97c8988ea7 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:09.159538 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-66c498fe-7b2a-4ac2-9c7d-2c97c8988ea7 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:09.160232 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-66c498fe-7b2a-4ac2-9c7d-2c97c8988ea7 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:09.160679 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-66c498fe-7b2a-4ac2-9c7d-2c97c8988ea7 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:09.161096 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-66c498fe-7b2a-4ac2-9c7d-2c97c8988ea7 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:09.300703 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-66c498fe-7b2a-4ac2-9c7d-2c97c8988ea7 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfff1e957f1464dbee571606dc39624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b064eb9c6944e11b79e161e4df5205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:09.309765 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-66c498fe-7b2a-4ac2-9c7d-2c97c8988ea7 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514" status: 200 len: 1313 microversion: 2.1 time: 0.161826 Aug 24 04:01:09.309765 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 485/976] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:09 2022] GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:10.330012 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-e2910d19-db62-451a-bc52-55fbd6762766 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:10.330644 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-e2910d19-db62-451a-bc52-55fbd6762766 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 37faf4af-c834-40c2-9548-5e38d79f1514] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:10.337214 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e2910d19-db62-451a-bc52-55fbd6762766 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:10.337859 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e2910d19-db62-451a-bc52-55fbd6762766 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:10.338114 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e2910d19-db62-451a-bc52-55fbd6762766 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:10.338960 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e2910d19-db62-451a-bc52-55fbd6762766 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:10.339405 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e2910d19-db62-451a-bc52-55fbd6762766 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:10.339819 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-e2910d19-db62-451a-bc52-55fbd6762766 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:10.497625 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-e2910d19-db62-451a-bc52-55fbd6762766 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfff1e957f1464dbee571606dc39624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b064eb9c6944e11b79e161e4df5205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:10.506925 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-e2910d19-db62-451a-bc52-55fbd6762766 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514" status: 200 len: 1498 microversion: 2.1 time: 0.181269 Aug 24 04:01:10.507582 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 492/977] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:10 2022] GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514 => generated 1498 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:11.825900 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dc900e47-bbb6-4124-a0ec-ca8ee649d5b4 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:11.825900 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-dc900e47-bbb6-4124-a0ec-ca8ee649d5b4 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 37faf4af-c834-40c2-9548-5e38d79f1514] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:11.832830 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc900e47-bbb6-4124-a0ec-ca8ee649d5b4 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:11.833316 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc900e47-bbb6-4124-a0ec-ca8ee649d5b4 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:11.833755 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc900e47-bbb6-4124-a0ec-ca8ee649d5b4 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:11.834526 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc900e47-bbb6-4124-a0ec-ca8ee649d5b4 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:11.834991 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc900e47-bbb6-4124-a0ec-ca8ee649d5b4 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:11.835418 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc900e47-bbb6-4124-a0ec-ca8ee649d5b4 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:11.863666 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-dc900e47-bbb6-4124-a0ec-ca8ee649d5b4 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 37faf4af-c834-40c2-9548-5e38d79f1514] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:01:12.207150 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-dc900e47-bbb6-4124-a0ec-ca8ee649d5b4 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "DELETE /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514" status: 204 len: 0 microversion: 2.1 time: 0.386238 Aug 24 04:01:12.207770 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 486/978] 10.222.0.82 () {58 vars in 1239 bytes} [Wed Aug 24 04:01:11 2022] DELETE /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 04:01:12.216895 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-8e3b7ab5-a8cb-41ca-8ce4-b63ca48f293c tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:12.220823 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-8e3b7ab5-a8cb-41ca-8ce4-b63ca48f293c tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 37faf4af-c834-40c2-9548-5e38d79f1514] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:12.224824 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8e3b7ab5-a8cb-41ca-8ce4-b63ca48f293c tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:12.225310 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8e3b7ab5-a8cb-41ca-8ce4-b63ca48f293c tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:12.225804 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8e3b7ab5-a8cb-41ca-8ce4-b63ca48f293c tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:12.226521 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8e3b7ab5-a8cb-41ca-8ce4-b63ca48f293c tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:12.227022 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8e3b7ab5-a8cb-41ca-8ce4-b63ca48f293c tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:12.227444 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8e3b7ab5-a8cb-41ca-8ce4-b63ca48f293c tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:12.361542 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-8e3b7ab5-a8cb-41ca-8ce4-b63ca48f293c tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfff1e957f1464dbee571606dc39624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b064eb9c6944e11b79e161e4df5205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:12.369261 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-8e3b7ab5-a8cb-41ca-8ce4-b63ca48f293c tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514" status: 200 len: 1504 microversion: 2.1 time: 0.156885 Aug 24 04:01:12.369828 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 493/979] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:12 2022] GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:13.392296 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5503df69-d3aa-4a41-ac7d-c3dae5791707 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:13.393020 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5503df69-d3aa-4a41-ac7d-c3dae5791707 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 37faf4af-c834-40c2-9548-5e38d79f1514] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:13.399512 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5503df69-d3aa-4a41-ac7d-c3dae5791707 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:13.399992 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5503df69-d3aa-4a41-ac7d-c3dae5791707 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:13.400420 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5503df69-d3aa-4a41-ac7d-c3dae5791707 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:13.401122 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5503df69-d3aa-4a41-ac7d-c3dae5791707 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:13.401589 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5503df69-d3aa-4a41-ac7d-c3dae5791707 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:13.402005 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5503df69-d3aa-4a41-ac7d-c3dae5791707 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:13.535800 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-5503df69-d3aa-4a41-ac7d-c3dae5791707 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfff1e957f1464dbee571606dc39624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b064eb9c6944e11b79e161e4df5205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:13.543575 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5503df69-d3aa-4a41-ac7d-c3dae5791707 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514" status: 200 len: 1504 microversion: 2.1 time: 0.156122 Aug 24 04:01:13.544173 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 487/980] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:13 2022] GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:14.564623 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-d46cb923-e29f-45ba-906b-334116608345 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:14.565277 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-d46cb923-e29f-45ba-906b-334116608345 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 37faf4af-c834-40c2-9548-5e38d79f1514] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:14.571826 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d46cb923-e29f-45ba-906b-334116608345 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:14.572304 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d46cb923-e29f-45ba-906b-334116608345 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:14.572734 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d46cb923-e29f-45ba-906b-334116608345 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:14.573411 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d46cb923-e29f-45ba-906b-334116608345 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:14.574040 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d46cb923-e29f-45ba-906b-334116608345 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:14.574489 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d46cb923-e29f-45ba-906b-334116608345 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:14.706842 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-d46cb923-e29f-45ba-906b-334116608345 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfff1e957f1464dbee571606dc39624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b064eb9c6944e11b79e161e4df5205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:14.710162 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:14.714650 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-d46cb923-e29f-45ba-906b-334116608345 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514" status: 200 len: 1504 microversion: 2.1 time: 0.153891 Aug 24 04:01:14.715210 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 494/981] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:14 2022] GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:15.737265 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-48424418-0b82-4707-8a7d-558e0d868c31 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:15.737919 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-48424418-0b82-4707-8a7d-558e0d868c31 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 37faf4af-c834-40c2-9548-5e38d79f1514] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:15.744393 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48424418-0b82-4707-8a7d-558e0d868c31 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:15.744873 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48424418-0b82-4707-8a7d-558e0d868c31 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:15.745305 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48424418-0b82-4707-8a7d-558e0d868c31 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:15.745991 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48424418-0b82-4707-8a7d-558e0d868c31 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:15.746443 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48424418-0b82-4707-8a7d-558e0d868c31 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:15.746900 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-48424418-0b82-4707-8a7d-558e0d868c31 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:15.881941 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-48424418-0b82-4707-8a7d-558e0d868c31 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfff1e957f1464dbee571606dc39624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b064eb9c6944e11b79e161e4df5205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:15.890318 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-48424418-0b82-4707-8a7d-558e0d868c31 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514" status: 200 len: 1504 microversion: 2.1 time: 0.157896 Aug 24 04:01:15.890934 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 488/982] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:15 2022] GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:16.241384 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-a42f6356-e068-46e0-acee-f9633add5cc3 req-8665113b-63ba-440a-b65a-3613b04218e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37faf4af-c834-40c2-9548-5e38d79f1514", "name": "network-vif-deleted", "tag": "7eb7cbed-379c-4476-8174-b713534bb784"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:01:16.253015 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-a42f6356-e068-46e0-acee-f9633add5cc3 req-8665113b-63ba-440a-b65a-3613b04218e1 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:16.253487 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-a42f6356-e068-46e0-acee-f9633add5cc3 req-8665113b-63ba-440a-b65a-3613b04218e1 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:16.253915 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-a42f6356-e068-46e0-acee-f9633add5cc3 req-8665113b-63ba-440a-b65a-3613b04218e1 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:16.269341 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-a42f6356-e068-46e0-acee-f9633add5cc3 req-8665113b-63ba-440a-b65a-3613b04218e1 service nova] Creating event network-vif-deleted:7eb7cbed-379c-4476-8174-b713534bb784 for instance 37faf4af-c834-40c2-9548-5e38d79f1514 on hv-cinder-85426 Aug 24 04:01:16.270449 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-a42f6356-e068-46e0-acee-f9633add5cc3 req-8665113b-63ba-440a-b65a-3613b04218e1 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033310 Aug 24 04:01:16.271070 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 495/983] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 04:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:01:16.912362 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-dc5a9a27-ae0c-4f76-bf76-a505271af90a tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:16.912983 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-dc5a9a27-ae0c-4f76-bf76-a505271af90a tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 37faf4af-c834-40c2-9548-5e38d79f1514] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:16.919299 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc5a9a27-ae0c-4f76-bf76-a505271af90a tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:16.922012 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc5a9a27-ae0c-4f76-bf76-a505271af90a tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:16.922012 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc5a9a27-ae0c-4f76-bf76-a505271af90a tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:16.922012 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc5a9a27-ae0c-4f76-bf76-a505271af90a tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:16.922012 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc5a9a27-ae0c-4f76-bf76-a505271af90a tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:16.922591 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc5a9a27-ae0c-4f76-bf76-a505271af90a tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:16.954724 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc5a9a27-ae0c-4f76-bf76-a505271af90a tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:16.955205 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc5a9a27-ae0c-4f76-bf76-a505271af90a tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:16.955640 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-dc5a9a27-ae0c-4f76-bf76-a505271af90a tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:16.956087 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-dc5a9a27-ae0c-4f76-bf76-a505271af90a tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lazy-loading 'fault' on Instance uuid 37faf4af-c834-40c2-9548-5e38d79f1514 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:01:16.998450 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-dc5a9a27-ae0c-4f76-bf76-a505271af90a tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfff1e957f1464dbee571606dc39624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b064eb9c6944e11b79e161e4df5205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:17.008029 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-dc5a9a27-ae0c-4f76-bf76-a505271af90a tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514" status: 200 len: 1303 microversion: 2.1 time: 0.099348 Aug 24 04:01:17.008613 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 489/984] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:16 2022] GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514 => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:18.032986 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-ac47ab3c-31e4-4d75-a45b-f992f0f9a7a5 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:18.033591 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-ac47ab3c-31e4-4d75-a45b-f992f0f9a7a5 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 37faf4af-c834-40c2-9548-5e38d79f1514] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:18.041068 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ac47ab3c-31e4-4d75-a45b-f992f0f9a7a5 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:18.041068 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ac47ab3c-31e4-4d75-a45b-f992f0f9a7a5 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:18.041068 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ac47ab3c-31e4-4d75-a45b-f992f0f9a7a5 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:18.041787 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ac47ab3c-31e4-4d75-a45b-f992f0f9a7a5 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:18.042229 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ac47ab3c-31e4-4d75-a45b-f992f0f9a7a5 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:18.042683 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ac47ab3c-31e4-4d75-a45b-f992f0f9a7a5 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:18.057535 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.wsgi [None req-ac47ab3c-31e4-4d75-a45b-f992f0f9a7a5 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] HTTP exception thrown: Instance 37faf4af-c834-40c2-9548-5e38d79f1514 could not be found. Aug 24 04:01:18.059259 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-ac47ab3c-31e4-4d75-a45b-f992f0f9a7a5 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Request method failure captured: Aug 24 04:01:18.059259 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: request: GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514 HTTP/1.1 Aug 24 04:01:18.059259 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept: application/json Aug 24 04:01:18.059259 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept-Encoding: identity Aug 24 04:01:18.059259 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Connection: close Aug 24 04:01:18.059259 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Length: 0 Aug 24 04:01:18.059259 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Type: application/json Aug 24 04:01:18.059259 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Host: 10.222.0.82 Aug 24 04:01:18.059259 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Openstack-System-Scope: None Aug 24 04:01:18.059259 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: User-Agent: python-urllib3/1.26.11 Aug 24 04:01:18.059259 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Auth-Token: gAAAAABjBaJtxof1uOwFKWo8TucWQk5GPzp_VVqzSkmnVBhlkV-XluO_MDsz3kgAserZ9f3Upq6WedXbw-Aze3iJbcrxHt-0z__29glE-Dq7pcc_I3za0lnH7E0HBk3KzLjZDV7sukuOhWKpn0M5Y2eMsCMTnNiDLYDfs_Zh4k77S8oqGsxmA20 Aug 24 04:01:18.059259 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Id: None Aug 24 04:01:18.059259 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Name: None Aug 24 04:01:18.059259 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Identity-Status: Confirmed Aug 24 04:01:18.059259 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Is-Admin-Project: True Aug 24 04:01:18.059259 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Id: default Aug 24 04:01:18.059259 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Name: Default Aug 24 04:01:18.059259 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Id: 3b064eb9c6944e11b79e161e4df5205a Aug 24 04:01:18.059259 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Name: tempest-VolumesActionsTest-1955217812 Aug 24 04:01:18.059259 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Role: member,reader Aug 24 04:01:18.059259 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Roles: member,reader Aug 24 04:01:18.061304 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/3b064eb9c6944e11b79e161e4df5205a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/3b064eb9c6944e11b79e161e4df5205a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/3b064eb9c6944e11b79e161e4df5205a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_3b064eb9c6944e11b79e161e4df5205a", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 04:01:18.061304 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant: tempest-VolumesActionsTest-1955217812 Aug 24 04:01:18.061304 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Id: 3b064eb9c6944e11b79e161e4df5205a Aug 24 04:01:18.061304 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Name: tempest-VolumesActionsTest-1955217812 Aug 24 04:01:18.061304 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User: tempest-VolumesActionsTest-1955217812-project Aug 24 04:01:18.061304 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Id: default Aug 24 04:01:18.061304 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Name: Default Aug 24 04:01:18.061304 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Id: 8cfff1e957f1464dbee571606dc39624 Aug 24 04:01:18.061304 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Name: tempest-VolumesActionsTest-1955217812-project Aug 24 04:01:18.061304 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: method: > Aug 24 04:01:18.061304 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: exception: Instance 37faf4af-c834-40c2-9548-5e38d79f1514 could not be found. Aug 24 04:01:18.061304 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: action_args: {'id': '37faf4af-c834-40c2-9548-5e38d79f1514'} Aug 24 04:01:18.062302 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:01:18.062302 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:01:18.062302 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:01:18.062302 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:01:18.062302 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:01:18.062302 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:01:18.062302 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:01:18.062302 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:01:18.062302 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:01:18.062302 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:01:18.062302 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37faf4af-c834-40c2-9548-5e38d79f1514 could not be found. Aug 24 04:01:18.062302 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 04:01:18.062302 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:01:18.062302 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 04:01:18.062302 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:01:18.062302 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:01:18.062302 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:01:18.062302 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:01:18.062302 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:01:18.062302 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:01:18.063695 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:01:18.063695 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:01:18.063695 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:01:18.063695 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:01:18.063695 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:01:18.063695 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:01:18.063695 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:01:18.063695 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37faf4af-c834-40c2-9548-5e38d79f1514 could not be found. Aug 24 04:01:18.063695 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 04:01:18.063695 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:01:18.063695 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 04:01:18.063695 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:01:18.063695 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:01:18.063695 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:01:18.063695 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:01:18.063695 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:01:18.063695 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37faf4af-c834-40c2-9548-5e38d79f1514 could not be found. Aug 24 04:01:18.063695 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 04:01:18.064797 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-ac47ab3c-31e4-4d75-a45b-f992f0f9a7a5 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Returning 404 to user: Instance 37faf4af-c834-40c2-9548-5e38d79f1514 could not be found. {{(pid=127869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:01:18.064797 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-ac47ab3c-31e4-4d75-a45b-f992f0f9a7a5 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514" status: 404 len: 111 microversion: 2.1 time: 0.034089 Aug 24 04:01:18.064797 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 496/985] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:18 2022] GET /compute/v2.1/servers/37faf4af-c834-40c2-9548-5e38d79f1514 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:01:18.179248 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1036c2bc-c2eb-454a-9548-2b10ed6ee39e tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1375287356", "imageRef": "c32522f7-22a8-45d4-a51e-f17637def2e1", "flavorRef": "452", "networks": [{"uuid": "ea1d8848-664e-4648-bdb6-2dc662f48fc5"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:01:18.237811 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-1036c2bc-c2eb-454a-9548-2b10ed6ee39e tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] validate_networks() for [('ea1d8848-664e-4648-bdb6-2dc662f48fc5', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:01:18.668926 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-1036c2bc-c2eb-454a-9548-2b10ed6ee39e tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:01:18.668926 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-1036c2bc-c2eb-454a-9548-2b10ed6ee39e tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:01:18.668926 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-1036c2bc-c2eb-454a-9548-2b10ed6ee39e tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:01:18.668926 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-1036c2bc-c2eb-454a-9548-2b10ed6ee39e tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:01:18.668926 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-1036c2bc-c2eb-454a-9548-2b10ed6ee39e tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:01:18.669451 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1036c2bc-c2eb-454a-9548-2b10ed6ee39e tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:18.669451 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1036c2bc-c2eb-454a-9548-2b10ed6ee39e tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:18.669451 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1036c2bc-c2eb-454a-9548-2b10ed6ee39e tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:18.669451 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1036c2bc-c2eb-454a-9548-2b10ed6ee39e tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:18.669819 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1036c2bc-c2eb-454a-9548-2b10ed6ee39e tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:18.669819 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1036c2bc-c2eb-454a-9548-2b10ed6ee39e tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:18.678370 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.quota [None req-1036c2bc-c2eb-454a-9548-2b10ed6ee39e tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Getting quotas for project 3b064eb9c6944e11b79e161e4df5205a. Resources: {'instances', 'cores', 'ram'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:01:18.682479 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.quota [None req-1036c2bc-c2eb-454a-9548-2b10ed6ee39e tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Getting quotas for user 8cfff1e957f1464dbee571606dc39624 and project 3b064eb9c6944e11b79e161e4df5205a. Resources: {'instances', 'cores', 'ram'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:01:18.695984 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1036c2bc-c2eb-454a-9548-2b10ed6ee39e tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:01:18.698281 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1036c2bc-c2eb-454a-9548-2b10ed6ee39e tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 58b30383-ccd4-45ba-958f-de59c146157c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c32522f7-22a8-45d4-a51e-f17637def2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:01:18.886138 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1036c2bc-c2eb-454a-9548-2b10ed6ee39e tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.710468 Aug 24 04:01:18.886890 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 490/986] 10.222.0.82 () {60 vars in 1147 bytes} [Wed Aug 24 04:01:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 04:01:18.899675 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-47c8c2cc-5dbc-415d-a5ff-19d5c6f3077e tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:18.900282 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-47c8c2cc-5dbc-415d-a5ff-19d5c6f3077e tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 58b30383-ccd4-45ba-958f-de59c146157c] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:18.968561 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-47c8c2cc-5dbc-415d-a5ff-19d5c6f3077e tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfff1e957f1464dbee571606dc39624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b064eb9c6944e11b79e161e4df5205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:18.975461 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-47c8c2cc-5dbc-415d-a5ff-19d5c6f3077e tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "GET /compute/v2.1/servers/58b30383-ccd4-45ba-958f-de59c146157c" status: 200 len: 1214 microversion: 2.1 time: 0.080642 Aug 24 04:01:18.989363 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 497/987] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:18 2022] GET /compute/v2.1/servers/58b30383-ccd4-45ba-958f-de59c146157c => generated 1214 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:19.997181 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ec8e0c8c-453d-446e-8da3-e1a767e5415a tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:19.997712 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ec8e0c8c-453d-446e-8da3-e1a767e5415a tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 58b30383-ccd4-45ba-958f-de59c146157c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:20.005183 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ec8e0c8c-453d-446e-8da3-e1a767e5415a tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:20.005624 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ec8e0c8c-453d-446e-8da3-e1a767e5415a tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:20.012518 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ec8e0c8c-453d-446e-8da3-e1a767e5415a tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:20.012518 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ec8e0c8c-453d-446e-8da3-e1a767e5415a tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:20.012518 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ec8e0c8c-453d-446e-8da3-e1a767e5415a tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:20.012518 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ec8e0c8c-453d-446e-8da3-e1a767e5415a tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:20.033279 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:20.081499 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-ec8e0c8c-453d-446e-8da3-e1a767e5415a tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfff1e957f1464dbee571606dc39624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b064eb9c6944e11b79e161e4df5205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:20.088095 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ec8e0c8c-453d-446e-8da3-e1a767e5415a tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "GET /compute/v2.1/servers/58b30383-ccd4-45ba-958f-de59c146157c" status: 200 len: 1218 microversion: 2.1 time: 0.095358 Aug 24 04:01:20.088680 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 491/988] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:19 2022] GET /compute/v2.1/servers/58b30383-ccd4-45ba-958f-de59c146157c => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:21.115069 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-198c26f2-bf86-4ec6-a7ce-8fc8045f5d75 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:21.115980 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-198c26f2-bf86-4ec6-a7ce-8fc8045f5d75 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 58b30383-ccd4-45ba-958f-de59c146157c] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:21.128068 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-198c26f2-bf86-4ec6-a7ce-8fc8045f5d75 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:21.128450 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-198c26f2-bf86-4ec6-a7ce-8fc8045f5d75 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:21.129658 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-198c26f2-bf86-4ec6-a7ce-8fc8045f5d75 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:21.129658 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-198c26f2-bf86-4ec6-a7ce-8fc8045f5d75 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:21.130084 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-198c26f2-bf86-4ec6-a7ce-8fc8045f5d75 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:21.130525 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-198c26f2-bf86-4ec6-a7ce-8fc8045f5d75 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:21.204359 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-198c26f2-bf86-4ec6-a7ce-8fc8045f5d75 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfff1e957f1464dbee571606dc39624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b064eb9c6944e11b79e161e4df5205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:21.212069 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-198c26f2-bf86-4ec6-a7ce-8fc8045f5d75 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "GET /compute/v2.1/servers/58b30383-ccd4-45ba-958f-de59c146157c" status: 200 len: 1284 microversion: 2.1 time: 0.104262 Aug 24 04:01:21.212638 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 498/989] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:21 2022] GET /compute/v2.1/servers/58b30383-ccd4-45ba-958f-de59c146157c => generated 1284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:22.234896 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-150f9c0e-8e5a-4c12-8560-2e1f50950d36 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:22.235718 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-150f9c0e-8e5a-4c12-8560-2e1f50950d36 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 58b30383-ccd4-45ba-958f-de59c146157c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:22.238402 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:22.243491 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-150f9c0e-8e5a-4c12-8560-2e1f50950d36 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:22.243971 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-150f9c0e-8e5a-4c12-8560-2e1f50950d36 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:22.244410 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-150f9c0e-8e5a-4c12-8560-2e1f50950d36 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:22.245115 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-150f9c0e-8e5a-4c12-8560-2e1f50950d36 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:22.245609 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-150f9c0e-8e5a-4c12-8560-2e1f50950d36 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:22.246036 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-150f9c0e-8e5a-4c12-8560-2e1f50950d36 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:22.399306 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-150f9c0e-8e5a-4c12-8560-2e1f50950d36 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfff1e957f1464dbee571606dc39624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b064eb9c6944e11b79e161e4df5205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:22.407570 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-150f9c0e-8e5a-4c12-8560-2e1f50950d36 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "GET /compute/v2.1/servers/58b30383-ccd4-45ba-958f-de59c146157c" status: 200 len: 1314 microversion: 2.1 time: 0.176768 Aug 24 04:01:22.408239 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 492/990] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:22 2022] GET /compute/v2.1/servers/58b30383-ccd4-45ba-958f-de59c146157c => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:22.778489 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-9df648f6-aaeb-4ea3-8f08-8c46455c704e req-55096b71-396c-4dcc-a106-9848e6202f1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58b30383-ccd4-45ba-958f-de59c146157c", "tag": "ca1eeaa5-1d2a-4a08-b2c4-16fd014137ab"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:01:22.785427 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:22.789634 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-9df648f6-aaeb-4ea3-8f08-8c46455c704e req-55096b71-396c-4dcc-a106-9848e6202f1d service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:22.790125 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-9df648f6-aaeb-4ea3-8f08-8c46455c704e req-55096b71-396c-4dcc-a106-9848e6202f1d service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:22.790834 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-9df648f6-aaeb-4ea3-8f08-8c46455c704e req-55096b71-396c-4dcc-a106-9848e6202f1d service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:22.803605 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-9df648f6-aaeb-4ea3-8f08-8c46455c704e req-55096b71-396c-4dcc-a106-9848e6202f1d service nova] Creating event network-changed:ca1eeaa5-1d2a-4a08-b2c4-16fd014137ab for instance 58b30383-ccd4-45ba-958f-de59c146157c on hv-cinder-85426 Aug 24 04:01:22.808724 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-9df648f6-aaeb-4ea3-8f08-8c46455c704e req-55096b71-396c-4dcc-a106-9848e6202f1d service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034196 Aug 24 04:01:22.809473 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 499/991] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 04:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:01:23.429837 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-85291f02-7450-4841-86e2-d35b1db4ef27 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:23.430443 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-85291f02-7450-4841-86e2-d35b1db4ef27 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 58b30383-ccd4-45ba-958f-de59c146157c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:23.447871 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85291f02-7450-4841-86e2-d35b1db4ef27 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:23.451276 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85291f02-7450-4841-86e2-d35b1db4ef27 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:23.451276 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85291f02-7450-4841-86e2-d35b1db4ef27 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:23.451276 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85291f02-7450-4841-86e2-d35b1db4ef27 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:23.451276 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85291f02-7450-4841-86e2-d35b1db4ef27 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:23.452136 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85291f02-7450-4841-86e2-d35b1db4ef27 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:23.625808 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-85291f02-7450-4841-86e2-d35b1db4ef27 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfff1e957f1464dbee571606dc39624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b064eb9c6944e11b79e161e4df5205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:23.633970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-85291f02-7450-4841-86e2-d35b1db4ef27 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "GET /compute/v2.1/servers/58b30383-ccd4-45ba-958f-de59c146157c" status: 200 len: 1314 microversion: 2.1 time: 0.208638 Aug 24 04:01:23.634561 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 493/992] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:23 2022] GET /compute/v2.1/servers/58b30383-ccd4-45ba-958f-de59c146157c => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:24.655153 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-94640207-1ba5-4637-a672-597d4a442f57 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:24.656014 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-94640207-1ba5-4637-a672-597d4a442f57 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 58b30383-ccd4-45ba-958f-de59c146157c] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:24.663461 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-94640207-1ba5-4637-a672-597d4a442f57 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:24.663946 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-94640207-1ba5-4637-a672-597d4a442f57 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:24.664382 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-94640207-1ba5-4637-a672-597d4a442f57 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:24.665070 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-94640207-1ba5-4637-a672-597d4a442f57 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:24.665522 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-94640207-1ba5-4637-a672-597d4a442f57 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:24.665939 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-94640207-1ba5-4637-a672-597d4a442f57 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:24.813812 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-94640207-1ba5-4637-a672-597d4a442f57 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfff1e957f1464dbee571606dc39624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b064eb9c6944e11b79e161e4df5205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:24.821553 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-94640207-1ba5-4637-a672-597d4a442f57 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "GET /compute/v2.1/servers/58b30383-ccd4-45ba-958f-de59c146157c" status: 200 len: 1314 microversion: 2.1 time: 0.170797 Aug 24 04:01:24.822212 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 500/993] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:24 2022] GET /compute/v2.1/servers/58b30383-ccd4-45ba-958f-de59c146157c => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:25.847802 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-289c68a4-c501-428b-92ab-79b41991f4cd tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:25.848417 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-289c68a4-c501-428b-92ab-79b41991f4cd tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 58b30383-ccd4-45ba-958f-de59c146157c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:25.854888 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-289c68a4-c501-428b-92ab-79b41991f4cd tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:25.855371 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-289c68a4-c501-428b-92ab-79b41991f4cd tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:25.855807 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-289c68a4-c501-428b-92ab-79b41991f4cd tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:25.856491 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-289c68a4-c501-428b-92ab-79b41991f4cd tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:25.856943 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-289c68a4-c501-428b-92ab-79b41991f4cd tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:25.857565 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-289c68a4-c501-428b-92ab-79b41991f4cd tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:25.999398 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-289c68a4-c501-428b-92ab-79b41991f4cd tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfff1e957f1464dbee571606dc39624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b064eb9c6944e11b79e161e4df5205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:26.007673 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-289c68a4-c501-428b-92ab-79b41991f4cd tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "GET /compute/v2.1/servers/58b30383-ccd4-45ba-958f-de59c146157c" status: 200 len: 1314 microversion: 2.1 time: 0.163956 Aug 24 04:01:26.008246 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 494/994] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:25 2022] GET /compute/v2.1/servers/58b30383-ccd4-45ba-958f-de59c146157c => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:27.030297 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-0d96f8dc-450d-46de-9ee9-c6731ab936fb tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:27.031534 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-0d96f8dc-450d-46de-9ee9-c6731ab936fb tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 58b30383-ccd4-45ba-958f-de59c146157c] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:27.038389 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0d96f8dc-450d-46de-9ee9-c6731ab936fb tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:27.038920 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0d96f8dc-450d-46de-9ee9-c6731ab936fb tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:27.039364 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0d96f8dc-450d-46de-9ee9-c6731ab936fb tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:27.040143 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0d96f8dc-450d-46de-9ee9-c6731ab936fb tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:27.040596 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0d96f8dc-450d-46de-9ee9-c6731ab936fb tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:27.041018 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0d96f8dc-450d-46de-9ee9-c6731ab936fb tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:27.190815 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-0d96f8dc-450d-46de-9ee9-c6731ab936fb tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfff1e957f1464dbee571606dc39624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b064eb9c6944e11b79e161e4df5205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:27.199637 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-0d96f8dc-450d-46de-9ee9-c6731ab936fb tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "GET /compute/v2.1/servers/58b30383-ccd4-45ba-958f-de59c146157c" status: 200 len: 1314 microversion: 2.1 time: 0.174261 Aug 24 04:01:27.214488 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 501/995] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:27 2022] GET /compute/v2.1/servers/58b30383-ccd4-45ba-958f-de59c146157c => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:28.220366 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3ca5c13e-7d11-458b-82b2-2d2432700a67 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:28.220975 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3ca5c13e-7d11-458b-82b2-2d2432700a67 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 58b30383-ccd4-45ba-958f-de59c146157c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:28.227432 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3ca5c13e-7d11-458b-82b2-2d2432700a67 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:28.227912 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3ca5c13e-7d11-458b-82b2-2d2432700a67 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:28.234420 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3ca5c13e-7d11-458b-82b2-2d2432700a67 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:28.234420 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3ca5c13e-7d11-458b-82b2-2d2432700a67 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:28.234420 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3ca5c13e-7d11-458b-82b2-2d2432700a67 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:28.234420 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3ca5c13e-7d11-458b-82b2-2d2432700a67 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:28.367858 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-3ca5c13e-7d11-458b-82b2-2d2432700a67 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfff1e957f1464dbee571606dc39624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b064eb9c6944e11b79e161e4df5205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:28.376029 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3ca5c13e-7d11-458b-82b2-2d2432700a67 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "GET /compute/v2.1/servers/58b30383-ccd4-45ba-958f-de59c146157c" status: 200 len: 1314 microversion: 2.1 time: 0.160112 Aug 24 04:01:28.376593 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 495/996] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:28 2022] GET /compute/v2.1/servers/58b30383-ccd4-45ba-958f-de59c146157c => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:29.397225 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-9470ba5c-8369-4fd8-be8e-3ce03e9b0aba tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:29.398135 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-9470ba5c-8369-4fd8-be8e-3ce03e9b0aba tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 58b30383-ccd4-45ba-958f-de59c146157c] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:29.405883 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell0:SELECT=2 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:29.407562 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9470ba5c-8369-4fd8-be8e-3ce03e9b0aba tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:29.408744 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9470ba5c-8369-4fd8-be8e-3ce03e9b0aba tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:29.408744 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9470ba5c-8369-4fd8-be8e-3ce03e9b0aba tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:29.409151 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9470ba5c-8369-4fd8-be8e-3ce03e9b0aba tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:29.409602 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9470ba5c-8369-4fd8-be8e-3ce03e9b0aba tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:29.410021 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9470ba5c-8369-4fd8-be8e-3ce03e9b0aba tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:29.564037 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-acd302be-11f8-410e-8ba1-39cfd2bcdfec req-a4924215-8ce5-470d-aa87-9a845e40d853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58b30383-ccd4-45ba-958f-de59c146157c", "name": "network-vif-plugged", "status": "completed", "tag": "ca1eeaa5-1d2a-4a08-b2c4-16fd014137ab"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:01:29.570019 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:29.571023 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:29.578129 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-acd302be-11f8-410e-8ba1-39cfd2bcdfec req-a4924215-8ce5-470d-aa87-9a845e40d853 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:29.578700 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-acd302be-11f8-410e-8ba1-39cfd2bcdfec req-a4924215-8ce5-470d-aa87-9a845e40d853 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:29.579134 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-acd302be-11f8-410e-8ba1-39cfd2bcdfec req-a4924215-8ce5-470d-aa87-9a845e40d853 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:29.591185 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-acd302be-11f8-410e-8ba1-39cfd2bcdfec req-a4924215-8ce5-470d-aa87-9a845e40d853 service nova] Creating event network-vif-plugged:ca1eeaa5-1d2a-4a08-b2c4-16fd014137ab for instance 58b30383-ccd4-45ba-958f-de59c146157c on hv-cinder-85426 Aug 24 04:01:29.598089 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-acd302be-11f8-410e-8ba1-39cfd2bcdfec req-a4924215-8ce5-470d-aa87-9a845e40d853 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038184 Aug 24 04:01:29.599175 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 496/997] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 04:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:01:29.820948 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-9470ba5c-8369-4fd8-be8e-3ce03e9b0aba tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfff1e957f1464dbee571606dc39624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b064eb9c6944e11b79e161e4df5205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:29.829316 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-9470ba5c-8369-4fd8-be8e-3ce03e9b0aba tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "GET /compute/v2.1/servers/58b30383-ccd4-45ba-958f-de59c146157c" status: 200 len: 1314 microversion: 2.1 time: 0.435976 Aug 24 04:01:29.829813 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 502/998] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:29 2022] GET /compute/v2.1/servers/58b30383-ccd4-45ba-958f-de59c146157c => generated 1314 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:30.852615 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-805ddca2-86ca-4a6c-a659-2496b23154b2 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:30.853315 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-805ddca2-86ca-4a6c-a659-2496b23154b2 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 58b30383-ccd4-45ba-958f-de59c146157c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:30.861191 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-805ddca2-86ca-4a6c-a659-2496b23154b2 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:30.861680 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-805ddca2-86ca-4a6c-a659-2496b23154b2 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:30.862115 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-805ddca2-86ca-4a6c-a659-2496b23154b2 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:30.862864 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-805ddca2-86ca-4a6c-a659-2496b23154b2 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:30.863757 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-805ddca2-86ca-4a6c-a659-2496b23154b2 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:30.864375 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-805ddca2-86ca-4a6c-a659-2496b23154b2 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:31.010907 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-805ddca2-86ca-4a6c-a659-2496b23154b2 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfff1e957f1464dbee571606dc39624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b064eb9c6944e11b79e161e4df5205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:31.030437 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-805ddca2-86ca-4a6c-a659-2496b23154b2 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "GET /compute/v2.1/servers/58b30383-ccd4-45ba-958f-de59c146157c" status: 200 len: 1314 microversion: 2.1 time: 0.182634 Aug 24 04:01:31.035707 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 497/999] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:30 2022] GET /compute/v2.1/servers/58b30383-ccd4-45ba-958f-de59c146157c => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:32.051805 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-0102624d-6f48-4a62-b4e0-9dd4202ff732 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:32.052645 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-0102624d-6f48-4a62-b4e0-9dd4202ff732 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 58b30383-ccd4-45ba-958f-de59c146157c] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:32.059363 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0102624d-6f48-4a62-b4e0-9dd4202ff732 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:32.060077 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0102624d-6f48-4a62-b4e0-9dd4202ff732 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:32.061371 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0102624d-6f48-4a62-b4e0-9dd4202ff732 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:32.062805 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0102624d-6f48-4a62-b4e0-9dd4202ff732 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:32.063210 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0102624d-6f48-4a62-b4e0-9dd4202ff732 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:32.063634 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0102624d-6f48-4a62-b4e0-9dd4202ff732 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:32.212091 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-0102624d-6f48-4a62-b4e0-9dd4202ff732 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfff1e957f1464dbee571606dc39624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b064eb9c6944e11b79e161e4df5205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:32.222538 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-0102624d-6f48-4a62-b4e0-9dd4202ff732 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "GET /compute/v2.1/servers/58b30383-ccd4-45ba-958f-de59c146157c" status: 200 len: 1499 microversion: 2.1 time: 0.174551 Aug 24 04:01:32.223232 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 503/1000] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:32 2022] GET /compute/v2.1/servers/58b30383-ccd4-45ba-958f-de59c146157c => generated 1499 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:35.921795 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bce1e65a-5c54-40cc-992f-1a92a870c0db tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:35.922388 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bce1e65a-5c54-40cc-992f-1a92a870c0db tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 58b30383-ccd4-45ba-958f-de59c146157c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:35.928829 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bce1e65a-5c54-40cc-992f-1a92a870c0db tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:35.929319 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bce1e65a-5c54-40cc-992f-1a92a870c0db tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:35.929961 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bce1e65a-5c54-40cc-992f-1a92a870c0db tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:35.930725 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bce1e65a-5c54-40cc-992f-1a92a870c0db tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:35.931178 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bce1e65a-5c54-40cc-992f-1a92a870c0db tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:35.931607 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bce1e65a-5c54-40cc-992f-1a92a870c0db tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:35.960915 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bce1e65a-5c54-40cc-992f-1a92a870c0db tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 58b30383-ccd4-45ba-958f-de59c146157c] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:01:36.265534 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bce1e65a-5c54-40cc-992f-1a92a870c0db tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "DELETE /compute/v2.1/servers/58b30383-ccd4-45ba-958f-de59c146157c" status: 204 len: 0 microversion: 2.1 time: 0.347543 Aug 24 04:01:36.266718 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 498/1001] 10.222.0.82 () {58 vars in 1239 bytes} [Wed Aug 24 04:01:35 2022] DELETE /compute/v2.1/servers/58b30383-ccd4-45ba-958f-de59c146157c => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:01:36.278081 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-eed15337-bd21-4c10-92c8-ad6899989a50 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:36.280054 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-eed15337-bd21-4c10-92c8-ad6899989a50 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 58b30383-ccd4-45ba-958f-de59c146157c] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:36.293684 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-eed15337-bd21-4c10-92c8-ad6899989a50 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:36.294176 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-eed15337-bd21-4c10-92c8-ad6899989a50 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:36.294915 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-eed15337-bd21-4c10-92c8-ad6899989a50 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:36.296063 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-eed15337-bd21-4c10-92c8-ad6899989a50 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:36.297786 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-eed15337-bd21-4c10-92c8-ad6899989a50 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:36.298398 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-eed15337-bd21-4c10-92c8-ad6899989a50 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:36.431150 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-eed15337-bd21-4c10-92c8-ad6899989a50 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfff1e957f1464dbee571606dc39624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b064eb9c6944e11b79e161e4df5205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:36.439940 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-eed15337-bd21-4c10-92c8-ad6899989a50 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "GET /compute/v2.1/servers/58b30383-ccd4-45ba-958f-de59c146157c" status: 200 len: 1505 microversion: 2.1 time: 0.168547 Aug 24 04:01:36.440825 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 504/1002] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:36 2022] GET /compute/v2.1/servers/58b30383-ccd4-45ba-958f-de59c146157c => generated 1505 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:01:37.460810 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-db1bab90-b82e-4d92-bd2f-643ea0923c79 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:37.461537 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-db1bab90-b82e-4d92-bd2f-643ea0923c79 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 58b30383-ccd4-45ba-958f-de59c146157c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:37.468173 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db1bab90-b82e-4d92-bd2f-643ea0923c79 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:37.468658 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db1bab90-b82e-4d92-bd2f-643ea0923c79 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:37.469100 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db1bab90-b82e-4d92-bd2f-643ea0923c79 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:37.469804 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db1bab90-b82e-4d92-bd2f-643ea0923c79 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:37.470259 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db1bab90-b82e-4d92-bd2f-643ea0923c79 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:37.470746 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-db1bab90-b82e-4d92-bd2f-643ea0923c79 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:37.605466 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-db1bab90-b82e-4d92-bd2f-643ea0923c79 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfff1e957f1464dbee571606dc39624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b064eb9c6944e11b79e161e4df5205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:37.613513 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-db1bab90-b82e-4d92-bd2f-643ea0923c79 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "GET /compute/v2.1/servers/58b30383-ccd4-45ba-958f-de59c146157c" status: 200 len: 1505 microversion: 2.1 time: 0.157060 Aug 24 04:01:37.614093 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 499/1003] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:37 2022] GET /compute/v2.1/servers/58b30383-ccd4-45ba-958f-de59c146157c => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:38.635457 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-1822fa07-452f-434e-bdbb-2027fb17e4d9 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:38.636008 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-1822fa07-452f-434e-bdbb-2027fb17e4d9 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 58b30383-ccd4-45ba-958f-de59c146157c] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:38.642984 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1822fa07-452f-434e-bdbb-2027fb17e4d9 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:38.643467 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1822fa07-452f-434e-bdbb-2027fb17e4d9 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:38.643906 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1822fa07-452f-434e-bdbb-2027fb17e4d9 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:38.644592 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1822fa07-452f-434e-bdbb-2027fb17e4d9 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:38.645042 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1822fa07-452f-434e-bdbb-2027fb17e4d9 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:38.645465 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1822fa07-452f-434e-bdbb-2027fb17e4d9 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:38.777676 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-1822fa07-452f-434e-bdbb-2027fb17e4d9 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfff1e957f1464dbee571606dc39624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b064eb9c6944e11b79e161e4df5205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:38.785931 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-1822fa07-452f-434e-bdbb-2027fb17e4d9 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "GET /compute/v2.1/servers/58b30383-ccd4-45ba-958f-de59c146157c" status: 200 len: 1505 microversion: 2.1 time: 0.155000 Aug 24 04:01:38.786485 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 505/1004] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:38 2022] GET /compute/v2.1/servers/58b30383-ccd4-45ba-958f-de59c146157c => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:39.806886 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e825297d-68ad-4714-98ad-7fccfbf18bdd tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:39.807608 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e825297d-68ad-4714-98ad-7fccfbf18bdd tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 58b30383-ccd4-45ba-958f-de59c146157c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:39.814906 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e825297d-68ad-4714-98ad-7fccfbf18bdd tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:39.815467 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e825297d-68ad-4714-98ad-7fccfbf18bdd tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:39.815895 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e825297d-68ad-4714-98ad-7fccfbf18bdd tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:39.816582 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e825297d-68ad-4714-98ad-7fccfbf18bdd tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:39.817028 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e825297d-68ad-4714-98ad-7fccfbf18bdd tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:39.817441 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e825297d-68ad-4714-98ad-7fccfbf18bdd tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:39.950670 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-e825297d-68ad-4714-98ad-7fccfbf18bdd tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfff1e957f1464dbee571606dc39624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b064eb9c6944e11b79e161e4df5205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:39.958314 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e825297d-68ad-4714-98ad-7fccfbf18bdd tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "GET /compute/v2.1/servers/58b30383-ccd4-45ba-958f-de59c146157c" status: 200 len: 1505 microversion: 2.1 time: 0.155624 Aug 24 04:01:39.958993 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 500/1005] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:39 2022] GET /compute/v2.1/servers/58b30383-ccd4-45ba-958f-de59c146157c => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:01:40.151557 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-e0cb3e71-e11c-40ac-8335-b5526bcc2158 req-737048ee-fb63-423f-a03f-a55bda1910af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58b30383-ccd4-45ba-958f-de59c146157c", "name": "network-vif-deleted", "tag": "ca1eeaa5-1d2a-4a08-b2c4-16fd014137ab"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:01:40.161865 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-e0cb3e71-e11c-40ac-8335-b5526bcc2158 req-737048ee-fb63-423f-a03f-a55bda1910af service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:40.162338 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-e0cb3e71-e11c-40ac-8335-b5526bcc2158 req-737048ee-fb63-423f-a03f-a55bda1910af service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:40.162793 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-e0cb3e71-e11c-40ac-8335-b5526bcc2158 req-737048ee-fb63-423f-a03f-a55bda1910af service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:40.174558 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-e0cb3e71-e11c-40ac-8335-b5526bcc2158 req-737048ee-fb63-423f-a03f-a55bda1910af service nova] Creating event network-vif-deleted:ca1eeaa5-1d2a-4a08-b2c4-16fd014137ab for instance 58b30383-ccd4-45ba-958f-de59c146157c on hv-cinder-85426 Aug 24 04:01:40.180167 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-e0cb3e71-e11c-40ac-8335-b5526bcc2158 req-737048ee-fb63-423f-a03f-a55bda1910af service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032057 Aug 24 04:01:40.180884 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 506/1006] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 04:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:01:40.980259 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2954e1eb-d62b-4662-916a-31d923927ca8 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:40.980939 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2954e1eb-d62b-4662-916a-31d923927ca8 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 58b30383-ccd4-45ba-958f-de59c146157c] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:40.988398 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2954e1eb-d62b-4662-916a-31d923927ca8 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:40.989717 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2954e1eb-d62b-4662-916a-31d923927ca8 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:40.989717 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2954e1eb-d62b-4662-916a-31d923927ca8 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:40.990034 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2954e1eb-d62b-4662-916a-31d923927ca8 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:40.990486 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2954e1eb-d62b-4662-916a-31d923927ca8 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:40.990926 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2954e1eb-d62b-4662-916a-31d923927ca8 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:41.024267 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2954e1eb-d62b-4662-916a-31d923927ca8 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:41.024808 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2954e1eb-d62b-4662-916a-31d923927ca8 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:41.025250 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2954e1eb-d62b-4662-916a-31d923927ca8 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:41.025701 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-2954e1eb-d62b-4662-916a-31d923927ca8 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lazy-loading 'fault' on Instance uuid 58b30383-ccd4-45ba-958f-de59c146157c {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:01:41.069721 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-2954e1eb-d62b-4662-916a-31d923927ca8 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfff1e957f1464dbee571606dc39624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b064eb9c6944e11b79e161e4df5205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:41.077488 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2954e1eb-d62b-4662-916a-31d923927ca8 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "GET /compute/v2.1/servers/58b30383-ccd4-45ba-958f-de59c146157c" status: 200 len: 1304 microversion: 2.1 time: 0.101047 Aug 24 04:01:41.078178 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 501/1007] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:40 2022] GET /compute/v2.1/servers/58b30383-ccd4-45ba-958f-de59c146157c => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:42.106342 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-bdb6c773-2aff-4bdf-a18c-24134df6f2c6 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:42.107728 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-bdb6c773-2aff-4bdf-a18c-24134df6f2c6 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] [instance: 58b30383-ccd4-45ba-958f-de59c146157c] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:42.114520 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bdb6c773-2aff-4bdf-a18c-24134df6f2c6 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:42.115041 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bdb6c773-2aff-4bdf-a18c-24134df6f2c6 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:42.115473 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bdb6c773-2aff-4bdf-a18c-24134df6f2c6 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:42.116167 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bdb6c773-2aff-4bdf-a18c-24134df6f2c6 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:42.116620 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bdb6c773-2aff-4bdf-a18c-24134df6f2c6 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:42.117041 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bdb6c773-2aff-4bdf-a18c-24134df6f2c6 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:42.131879 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.wsgi [None req-bdb6c773-2aff-4bdf-a18c-24134df6f2c6 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] HTTP exception thrown: Instance 58b30383-ccd4-45ba-958f-de59c146157c could not be found. Aug 24 04:01:42.133555 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-bdb6c773-2aff-4bdf-a18c-24134df6f2c6 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Request method failure captured: Aug 24 04:01:42.133555 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: request: GET /compute/v2.1/servers/58b30383-ccd4-45ba-958f-de59c146157c HTTP/1.1 Aug 24 04:01:42.133555 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept: application/json Aug 24 04:01:42.133555 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept-Encoding: identity Aug 24 04:01:42.133555 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Connection: close Aug 24 04:01:42.133555 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Length: 0 Aug 24 04:01:42.133555 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Type: application/json Aug 24 04:01:42.133555 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Host: 10.222.0.82 Aug 24 04:01:42.133555 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Openstack-System-Scope: None Aug 24 04:01:42.133555 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: User-Agent: python-urllib3/1.26.11 Aug 24 04:01:42.133555 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Auth-Token: gAAAAABjBaJtxof1uOwFKWo8TucWQk5GPzp_VVqzSkmnVBhlkV-XluO_MDsz3kgAserZ9f3Upq6WedXbw-Aze3iJbcrxHt-0z__29glE-Dq7pcc_I3za0lnH7E0HBk3KzLjZDV7sukuOhWKpn0M5Y2eMsCMTnNiDLYDfs_Zh4k77S8oqGsxmA20 Aug 24 04:01:42.133555 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Id: None Aug 24 04:01:42.133555 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Name: None Aug 24 04:01:42.133555 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Identity-Status: Confirmed Aug 24 04:01:42.133555 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Is-Admin-Project: True Aug 24 04:01:42.133555 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Id: default Aug 24 04:01:42.133555 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Name: Default Aug 24 04:01:42.133555 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Id: 3b064eb9c6944e11b79e161e4df5205a Aug 24 04:01:42.133555 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Name: tempest-VolumesActionsTest-1955217812 Aug 24 04:01:42.133555 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Role: member,reader Aug 24 04:01:42.133555 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Roles: member,reader Aug 24 04:01:42.135318 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/3b064eb9c6944e11b79e161e4df5205a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/3b064eb9c6944e11b79e161e4df5205a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/3b064eb9c6944e11b79e161e4df5205a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_3b064eb9c6944e11b79e161e4df5205a", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 04:01:42.135318 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant: tempest-VolumesActionsTest-1955217812 Aug 24 04:01:42.135318 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Id: 3b064eb9c6944e11b79e161e4df5205a Aug 24 04:01:42.135318 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Name: tempest-VolumesActionsTest-1955217812 Aug 24 04:01:42.135318 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User: tempest-VolumesActionsTest-1955217812-project Aug 24 04:01:42.135318 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Id: default Aug 24 04:01:42.135318 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Name: Default Aug 24 04:01:42.135318 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Id: 8cfff1e957f1464dbee571606dc39624 Aug 24 04:01:42.135318 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Name: tempest-VolumesActionsTest-1955217812-project Aug 24 04:01:42.135318 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: method: > Aug 24 04:01:42.135318 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: exception: Instance 58b30383-ccd4-45ba-958f-de59c146157c could not be found. Aug 24 04:01:42.135318 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: action_args: {'id': '58b30383-ccd4-45ba-958f-de59c146157c'} Aug 24 04:01:42.136443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:01:42.136443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:01:42.136443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:01:42.136443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:01:42.136443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:01:42.136443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:01:42.136443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:01:42.136443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:01:42.136443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:01:42.136443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:01:42.136443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58b30383-ccd4-45ba-958f-de59c146157c could not be found. Aug 24 04:01:42.136443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 04:01:42.136443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:01:42.136443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 04:01:42.136443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:01:42.136443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:01:42.136443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:01:42.136443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:01:42.136443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:01:42.136443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:01:42.138142 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:01:42.138142 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:01:42.138142 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:01:42.138142 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:01:42.138142 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:01:42.138142 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:01:42.138142 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:01:42.138142 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58b30383-ccd4-45ba-958f-de59c146157c could not be found. Aug 24 04:01:42.138142 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 04:01:42.138142 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:01:42.138142 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 04:01:42.138142 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:01:42.138142 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:01:42.138142 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:01:42.138142 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:01:42.138142 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:01:42.138142 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58b30383-ccd4-45ba-958f-de59c146157c could not be found. Aug 24 04:01:42.138142 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 04:01:42.139784 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-bdb6c773-2aff-4bdf-a18c-24134df6f2c6 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] Returning 404 to user: Instance 58b30383-ccd4-45ba-958f-de59c146157c could not be found. {{(pid=127869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:01:42.139784 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-bdb6c773-2aff-4bdf-a18c-24134df6f2c6 tempest-VolumesActionsTest-1955217812 tempest-VolumesActionsTest-1955217812-project] 10.222.0.82 "GET /compute/v2.1/servers/58b30383-ccd4-45ba-958f-de59c146157c" status: 404 len: 111 microversion: 2.1 time: 0.032984 Aug 24 04:01:42.139784 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 507/1008] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:42 2022] GET /compute/v2.1/servers/58b30383-ccd4-45ba-958f-de59c146157c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:02:11.693392 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:02:11.694141 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:02:11.900530 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e0fe27ff-6e8e-40eb-8f11-b06fedc26aed tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Action: 'create', calling method: .version_select at 0x7f1554388ca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-166112542", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkaYuIYlY8HcM2c/MjABU+K5AFrUqlm1C4SRmqewtrMuVcxbmhRwDooPpkR68t7VaFXgXK0K5HONipvttZvlXuA/A4+IyJXksIZBcyicNc6HYRzEAiNtx93H38PUcA0sw=="}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:02:11.916297 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.quota [None req-e0fe27ff-6e8e-40eb-8f11-b06fedc26aed tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Getting quotas for project 8d390e7ad1454a8182258cd72bea4fa5. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:02:11.923400 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.quota [None req-e0fe27ff-6e8e-40eb-8f11-b06fedc26aed tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Getting quotas for user 34d452ce6a1245c192acf8c87651fe92 and project 8d390e7ad1454a8182258cd72bea4fa5. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:02:12.078001 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e0fe27ff-6e8e-40eb-8f11-b06fedc26aed tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.389796 Aug 24 04:02:12.078906 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 502/1009] 10.222.0.82 () {60 vars in 1159 bytes} [Wed Aug 24 04:02:11 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:02:20.209362 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:02:20.209944 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Wed Aug 24 04:02:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:02:21.543584 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:02:21.544463 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Wed Aug 24 04:02:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:02:32.060533 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-f3e797cf-a7fa-45b3-8c0f-01014bfb1b03 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1427949018", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-166112542", "security_groups": [{"name": "tempest-secgroup-smoke-1291274157"}], "block_device_mapping_v2": [{"uuid": "b597d5be-ebfe-458a-a141-b5287e46c1c0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "01c2e76d-69cf-4147-aee5-37246a863c64"}]}} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:02:32.079476 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_api:SELECT=17 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:02:32.080375 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell1:SELECT=52 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:02:32.420794 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.network.neutron [None req-f3e797cf-a7fa-45b3-8c0f-01014bfb1b03 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] validate_networks() for [('01c2e76d-69cf-4147-aee5-37246a863c64', None, None, None, None, None)] {{(pid=127869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:02:32.863542 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-f3e797cf-a7fa-45b3-8c0f-01014bfb1b03 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Flavor limits 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:02:32.863962 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-f3e797cf-a7fa-45b3-8c0f-01014bfb1b03 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Image limits 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:02:32.864454 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-f3e797cf-a7fa-45b3-8c0f-01014bfb1b03 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Flavor pref 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:02:32.864857 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-f3e797cf-a7fa-45b3-8c0f-01014bfb1b03 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Image pref 0:0:0 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:02:32.865257 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.virt.hardware [None req-f3e797cf-a7fa-45b3-8c0f-01014bfb1b03 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:02:32.874653 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f3e797cf-a7fa-45b3-8c0f-01014bfb1b03 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:32.875360 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f3e797cf-a7fa-45b3-8c0f-01014bfb1b03 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:32.875787 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f3e797cf-a7fa-45b3-8c0f-01014bfb1b03 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:32.876503 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f3e797cf-a7fa-45b3-8c0f-01014bfb1b03 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:32.876952 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f3e797cf-a7fa-45b3-8c0f-01014bfb1b03 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:32.877632 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f3e797cf-a7fa-45b3-8c0f-01014bfb1b03 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:32.894976 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.quota [None req-f3e797cf-a7fa-45b3-8c0f-01014bfb1b03 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Getting quotas for project 8d390e7ad1454a8182258cd72bea4fa5. Resources: {'instances', 'cores', 'ram'} {{(pid=127869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:02:32.898959 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.quota [None req-f3e797cf-a7fa-45b3-8c0f-01014bfb1b03 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Getting quotas for user 34d452ce6a1245c192acf8c87651fe92 and project 8d390e7ad1454a8182258cd72bea4fa5. Resources: {'instances', 'cores', 'ram'} {{(pid=127869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:02:32.968551 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-f3e797cf-a7fa-45b3-8c0f-01014bfb1b03 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Going to run 1 instances... {{(pid=127869) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:02:32.972876 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-f3e797cf-a7fa-45b3-8c0f-01014bfb1b03 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 50398eec-9c47-426e-bf0b-3e1e8ed38f55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b597d5be-ebfe-458a-a141-b5287e46c1c0',volume_size=None,volume_type=None)] {{(pid=127869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:02:33.404342 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-f3e797cf-a7fa-45b3-8c0f-01014bfb1b03 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.349709 Aug 24 04:02:33.405164 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 508/1010] 10.222.0.82 () {60 vars in 1147 bytes} [Wed Aug 24 04:02:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 1351 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:02:33.416163 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f076e339-830f-4699-8849-ba5915d957a5 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:33.421884 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f076e339-830f-4699-8849-ba5915d957a5 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 50398eec-9c47-426e-bf0b-3e1e8ed38f55] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:33.433981 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=4 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:02:33.436842 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:02:33.705811 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-f076e339-830f-4699-8849-ba5915d957a5 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:33.709873 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f076e339-830f-4699-8849-ba5915d957a5 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55" status: 200 len: 1094 microversion: 2.1 time: 0.297741 Aug 24 04:02:33.710692 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 503/1011] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:33 2022] GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55 => generated 1094 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:34.732780 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-09066f74-6fd8-4a95-ab79-f8db3322d8fb tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:34.733391 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-09066f74-6fd8-4a95-ab79-f8db3322d8fb tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 50398eec-9c47-426e-bf0b-3e1e8ed38f55] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:34.741940 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-09066f74-6fd8-4a95-ab79-f8db3322d8fb tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:34.742434 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-09066f74-6fd8-4a95-ab79-f8db3322d8fb tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:34.742910 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-09066f74-6fd8-4a95-ab79-f8db3322d8fb tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:34.743616 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-09066f74-6fd8-4a95-ab79-f8db3322d8fb tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:34.744233 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-09066f74-6fd8-4a95-ab79-f8db3322d8fb tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:34.745456 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-09066f74-6fd8-4a95-ab79-f8db3322d8fb tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:34.808840 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-09066f74-6fd8-4a95-ab79-f8db3322d8fb tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:34.816651 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-09066f74-6fd8-4a95-ab79-f8db3322d8fb tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55" status: 200 len: 1144 microversion: 2.1 time: 0.088656 Aug 24 04:02:34.829828 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 509/1012] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:34 2022] GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55 => generated 1144 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:35.837811 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-788e8a21-e983-4fbc-88ad-9dc8ca7dfad7 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:35.842894 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-788e8a21-e983-4fbc-88ad-9dc8ca7dfad7 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 50398eec-9c47-426e-bf0b-3e1e8ed38f55] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:35.851953 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-788e8a21-e983-4fbc-88ad-9dc8ca7dfad7 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:35.853044 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-788e8a21-e983-4fbc-88ad-9dc8ca7dfad7 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:35.853675 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-788e8a21-e983-4fbc-88ad-9dc8ca7dfad7 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:35.855582 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-788e8a21-e983-4fbc-88ad-9dc8ca7dfad7 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:35.856315 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-788e8a21-e983-4fbc-88ad-9dc8ca7dfad7 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:35.856936 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-788e8a21-e983-4fbc-88ad-9dc8ca7dfad7 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:35.968182 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-788e8a21-e983-4fbc-88ad-9dc8ca7dfad7 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:35.981964 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-788e8a21-e983-4fbc-88ad-9dc8ca7dfad7 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55" status: 200 len: 1192 microversion: 2.1 time: 0.147864 Aug 24 04:02:35.983934 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 504/1013] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:35 2022] GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55 => generated 1192 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:37.009803 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-491e7aee-e028-49fd-bfef-fccf149affbb tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:37.013729 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-491e7aee-e028-49fd-bfef-fccf149affbb tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 50398eec-9c47-426e-bf0b-3e1e8ed38f55] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:37.027516 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-491e7aee-e028-49fd-bfef-fccf149affbb tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:37.029892 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-491e7aee-e028-49fd-bfef-fccf149affbb tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:37.032494 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-491e7aee-e028-49fd-bfef-fccf149affbb tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:37.033295 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-491e7aee-e028-49fd-bfef-fccf149affbb tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:37.045030 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-491e7aee-e028-49fd-bfef-fccf149affbb tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:37.045030 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-491e7aee-e028-49fd-bfef-fccf149affbb tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:37.256327 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-491e7aee-e028-49fd-bfef-fccf149affbb tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:37.266996 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-491e7aee-e028-49fd-bfef-fccf149affbb tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55" status: 200 len: 1278 microversion: 2.1 time: 0.265097 Aug 24 04:02:37.267841 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 510/1014] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:37 2022] GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55 => generated 1278 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:38.236088 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-4e2d0afa-b6d3-43ed-95bd-dd5e67c35430 req-2322fb4d-52e1-4796-9680-b6e02e71bcd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50398eec-9c47-426e-bf0b-3e1e8ed38f55", "tag": "07fe2eb5-8d8e-4476-ac4f-3d339990371b"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:02:38.248070 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-4e2d0afa-b6d3-43ed-95bd-dd5e67c35430 req-2322fb4d-52e1-4796-9680-b6e02e71bcd5 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:38.248549 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-4e2d0afa-b6d3-43ed-95bd-dd5e67c35430 req-2322fb4d-52e1-4796-9680-b6e02e71bcd5 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:38.248983 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-4e2d0afa-b6d3-43ed-95bd-dd5e67c35430 req-2322fb4d-52e1-4796-9680-b6e02e71bcd5 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:38.261508 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-4e2d0afa-b6d3-43ed-95bd-dd5e67c35430 req-2322fb4d-52e1-4796-9680-b6e02e71bcd5 service nova] Creating event network-changed:07fe2eb5-8d8e-4476-ac4f-3d339990371b for instance 50398eec-9c47-426e-bf0b-3e1e8ed38f55 on hv-cinder-85426 Aug 24 04:02:38.266727 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-4e2d0afa-b6d3-43ed-95bd-dd5e67c35430 req-2322fb4d-52e1-4796-9680-b6e02e71bcd5 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034119 Aug 24 04:02:38.267754 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 505/1015] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 04:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:02:38.294041 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-8d51adba-3238-46cb-9fb4-3de82cd457a2 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:38.294898 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-8d51adba-3238-46cb-9fb4-3de82cd457a2 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 50398eec-9c47-426e-bf0b-3e1e8ed38f55] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:38.302900 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8d51adba-3238-46cb-9fb4-3de82cd457a2 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:38.303386 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8d51adba-3238-46cb-9fb4-3de82cd457a2 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:38.303819 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8d51adba-3238-46cb-9fb4-3de82cd457a2 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:38.304513 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8d51adba-3238-46cb-9fb4-3de82cd457a2 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:38.304964 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8d51adba-3238-46cb-9fb4-3de82cd457a2 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:38.305684 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8d51adba-3238-46cb-9fb4-3de82cd457a2 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:38.525399 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-8d51adba-3238-46cb-9fb4-3de82cd457a2 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:38.535762 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-8d51adba-3238-46cb-9fb4-3de82cd457a2 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55" status: 200 len: 1266 microversion: 2.1 time: 0.247036 Aug 24 04:02:38.550106 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 511/1016] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:38 2022] GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55 => generated 1266 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:39.557957 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-79d5ae9e-81ba-46c0-b059-b0287688a0f8 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:39.559310 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-79d5ae9e-81ba-46c0-b059-b0287688a0f8 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 50398eec-9c47-426e-bf0b-3e1e8ed38f55] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:39.566896 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79d5ae9e-81ba-46c0-b059-b0287688a0f8 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:39.567531 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79d5ae9e-81ba-46c0-b059-b0287688a0f8 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:39.568139 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79d5ae9e-81ba-46c0-b059-b0287688a0f8 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:39.569033 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79d5ae9e-81ba-46c0-b059-b0287688a0f8 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:39.569642 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79d5ae9e-81ba-46c0-b059-b0287688a0f8 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:39.570224 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-79d5ae9e-81ba-46c0-b059-b0287688a0f8 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:39.731392 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-79d5ae9e-81ba-46c0-b059-b0287688a0f8 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:39.741001 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-79d5ae9e-81ba-46c0-b059-b0287688a0f8 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55" status: 200 len: 1266 microversion: 2.1 time: 0.187611 Aug 24 04:02:39.741686 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 506/1017] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:39 2022] GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:40.763462 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-7880447d-428c-4a14-bf1f-4b4e3979ac11 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:40.764351 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-7880447d-428c-4a14-bf1f-4b4e3979ac11 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 50398eec-9c47-426e-bf0b-3e1e8ed38f55] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:40.775661 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7880447d-428c-4a14-bf1f-4b4e3979ac11 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:40.777112 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7880447d-428c-4a14-bf1f-4b4e3979ac11 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:40.777344 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7880447d-428c-4a14-bf1f-4b4e3979ac11 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:40.778047 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7880447d-428c-4a14-bf1f-4b4e3979ac11 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:40.778526 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7880447d-428c-4a14-bf1f-4b4e3979ac11 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:40.778946 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7880447d-428c-4a14-bf1f-4b4e3979ac11 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:40.921743 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-7880447d-428c-4a14-bf1f-4b4e3979ac11 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:40.929642 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-7880447d-428c-4a14-bf1f-4b4e3979ac11 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55" status: 200 len: 1266 microversion: 2.1 time: 0.170990 Aug 24 04:02:40.943169 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 512/1018] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:40 2022] GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:41.955728 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-e9388a42-bdf5-45f1-8725-26e09e718dc3 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:41.956462 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-e9388a42-bdf5-45f1-8725-26e09e718dc3 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 50398eec-9c47-426e-bf0b-3e1e8ed38f55] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:41.963667 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e9388a42-bdf5-45f1-8725-26e09e718dc3 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:41.964356 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e9388a42-bdf5-45f1-8725-26e09e718dc3 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:41.964863 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e9388a42-bdf5-45f1-8725-26e09e718dc3 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:41.965894 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e9388a42-bdf5-45f1-8725-26e09e718dc3 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:41.966577 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e9388a42-bdf5-45f1-8725-26e09e718dc3 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:41.967008 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-e9388a42-bdf5-45f1-8725-26e09e718dc3 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:42.202820 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-e9388a42-bdf5-45f1-8725-26e09e718dc3 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:42.213716 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-e9388a42-bdf5-45f1-8725-26e09e718dc3 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55" status: 200 len: 1266 microversion: 2.1 time: 0.265484 Aug 24 04:02:42.214908 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 507/1019] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:41 2022] GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55 => generated 1266 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:43.235405 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-60c12690-f954-41c5-a8f8-fd5be8dfa8f4 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:43.236023 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-60c12690-f954-41c5-a8f8-fd5be8dfa8f4 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 50398eec-9c47-426e-bf0b-3e1e8ed38f55] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:43.238427 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell0:SELECT=2 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:02:43.239130 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell0:SELECT=6 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:02:43.244595 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-60c12690-f954-41c5-a8f8-fd5be8dfa8f4 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:43.245096 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-60c12690-f954-41c5-a8f8-fd5be8dfa8f4 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:43.245542 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-60c12690-f954-41c5-a8f8-fd5be8dfa8f4 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:43.246352 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-60c12690-f954-41c5-a8f8-fd5be8dfa8f4 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:43.246758 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-60c12690-f954-41c5-a8f8-fd5be8dfa8f4 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:43.247189 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-60c12690-f954-41c5-a8f8-fd5be8dfa8f4 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:43.399891 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-60c12690-f954-41c5-a8f8-fd5be8dfa8f4 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:43.409093 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-60c12690-f954-41c5-a8f8-fd5be8dfa8f4 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55" status: 200 len: 1266 microversion: 2.1 time: 0.177687 Aug 24 04:02:43.409663 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 513/1020] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:43 2022] GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:43.583510 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-386033c6-ce60-4811-890c-f6e0abd04816 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Action: 'create', calling method: .version_select at 0x7f1554363160>, body: {"keypair": {"name": "tempest-TestShelveInstance-1911518088", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMXkcsNbDnI0/KVlcWqfUc33iO/WEr5IW92bpMdY1MTmkgPAahlXEvX5N+n9MunIZVzTSXcIh5MDKxSTXb7MsCBUC9oY9qHnFNYExi0GJyJbH7gdHwFxcFzjYmXd+V2cA=="}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:02:43.599475 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.quota [None req-386033c6-ce60-4811-890c-f6e0abd04816 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Getting quotas for project c4943c05bd844f8d940def9908078748. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:02:43.603292 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.quota [None req-386033c6-ce60-4811-890c-f6e0abd04816 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Getting quotas for user aa39ed4cd12348c58eef09330af9c000 and project c4943c05bd844f8d940def9908078748. Resources: {'key_pairs'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:02:43.733007 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-386033c6-ce60-4811-890c-f6e0abd04816 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.318643 Aug 24 04:02:43.733871 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 508/1021] 10.222.0.82 () {60 vars in 1159 bytes} [Wed Aug 24 04:02:43 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:02:44.429852 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-f8e69fd6-0d32-42c4-85e2-bbbc01596f9f tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:44.430637 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-f8e69fd6-0d32-42c4-85e2-bbbc01596f9f tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 50398eec-9c47-426e-bf0b-3e1e8ed38f55] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:44.438198 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f8e69fd6-0d32-42c4-85e2-bbbc01596f9f tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:44.438877 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f8e69fd6-0d32-42c4-85e2-bbbc01596f9f tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:44.439414 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f8e69fd6-0d32-42c4-85e2-bbbc01596f9f tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:44.440190 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f8e69fd6-0d32-42c4-85e2-bbbc01596f9f tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:44.440749 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f8e69fd6-0d32-42c4-85e2-bbbc01596f9f tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:44.441237 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f8e69fd6-0d32-42c4-85e2-bbbc01596f9f tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:44.620986 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-f8e69fd6-0d32-42c4-85e2-bbbc01596f9f tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:44.629629 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-f8e69fd6-0d32-42c4-85e2-bbbc01596f9f tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55" status: 200 len: 1266 microversion: 2.1 time: 0.203849 Aug 24 04:02:44.631980 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 514/1022] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:44 2022] GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55 => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:45.651960 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-8601bd56-c462-4c99-9567-a8ecc7e49b2e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:45.652745 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-8601bd56-c462-4c99-9567-a8ecc7e49b2e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 50398eec-9c47-426e-bf0b-3e1e8ed38f55] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:45.666195 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8601bd56-c462-4c99-9567-a8ecc7e49b2e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:45.666195 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8601bd56-c462-4c99-9567-a8ecc7e49b2e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:45.666195 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8601bd56-c462-4c99-9567-a8ecc7e49b2e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:45.666195 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8601bd56-c462-4c99-9567-a8ecc7e49b2e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:45.666768 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8601bd56-c462-4c99-9567-a8ecc7e49b2e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:45.666768 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-8601bd56-c462-4c99-9567-a8ecc7e49b2e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:45.911874 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-8601bd56-c462-4c99-9567-a8ecc7e49b2e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:45.921668 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-8601bd56-c462-4c99-9567-a8ecc7e49b2e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55" status: 200 len: 1266 microversion: 2.1 time: 0.274732 Aug 24 04:02:45.933317 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 509/1023] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:45 2022] GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55 => generated 1266 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:46.943042 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-0d49be59-b546-4588-b181-0e669cde4ddb tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:46.943644 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-0d49be59-b546-4588-b181-0e669cde4ddb tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 50398eec-9c47-426e-bf0b-3e1e8ed38f55] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:46.950350 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0d49be59-b546-4588-b181-0e669cde4ddb tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:46.950862 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0d49be59-b546-4588-b181-0e669cde4ddb tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:46.951294 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0d49be59-b546-4588-b181-0e669cde4ddb tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:46.951972 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0d49be59-b546-4588-b181-0e669cde4ddb tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:46.952421 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0d49be59-b546-4588-b181-0e669cde4ddb tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:46.952837 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0d49be59-b546-4588-b181-0e669cde4ddb tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:47.092511 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-0d49be59-b546-4588-b181-0e669cde4ddb tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:47.100044 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-0d49be59-b546-4588-b181-0e669cde4ddb tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55" status: 200 len: 1266 microversion: 2.1 time: 0.161292 Aug 24 04:02:47.100593 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 515/1024] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:46 2022] GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:48.124032 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1d42b2b8-a937-46b3-8372-e2c2a6ffa84e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:48.124785 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1d42b2b8-a937-46b3-8372-e2c2a6ffa84e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 50398eec-9c47-426e-bf0b-3e1e8ed38f55] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:48.133868 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d42b2b8-a937-46b3-8372-e2c2a6ffa84e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:48.134387 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d42b2b8-a937-46b3-8372-e2c2a6ffa84e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:48.135463 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d42b2b8-a937-46b3-8372-e2c2a6ffa84e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:48.137656 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d42b2b8-a937-46b3-8372-e2c2a6ffa84e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:48.138878 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d42b2b8-a937-46b3-8372-e2c2a6ffa84e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:48.139006 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1d42b2b8-a937-46b3-8372-e2c2a6ffa84e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:48.304588 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-1d42b2b8-a937-46b3-8372-e2c2a6ffa84e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:48.314221 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1d42b2b8-a937-46b3-8372-e2c2a6ffa84e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55" status: 200 len: 1266 microversion: 2.1 time: 0.196528 Aug 24 04:02:48.314978 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 510/1025] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:48 2022] GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55 => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:49.335622 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-d3031d08-89e1-40b0-b579-347129ac6d08 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:49.336207 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-d3031d08-89e1-40b0-b579-347129ac6d08 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 50398eec-9c47-426e-bf0b-3e1e8ed38f55] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:49.346180 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d3031d08-89e1-40b0-b579-347129ac6d08 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:49.346697 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d3031d08-89e1-40b0-b579-347129ac6d08 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:49.347136 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d3031d08-89e1-40b0-b579-347129ac6d08 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:49.347833 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d3031d08-89e1-40b0-b579-347129ac6d08 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:49.348287 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d3031d08-89e1-40b0-b579-347129ac6d08 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:49.348711 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d3031d08-89e1-40b0-b579-347129ac6d08 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:49.484685 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-d3031d08-89e1-40b0-b579-347129ac6d08 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:49.492418 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-d3031d08-89e1-40b0-b579-347129ac6d08 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55" status: 200 len: 1266 microversion: 2.1 time: 0.161810 Aug 24 04:02:49.492983 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 516/1026] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:49 2022] GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:50.389044 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-050de5ca-ff3c-4d28-8c89-b03387b48df8 req-2b6f1bdd-48cd-4d85-bc14-836c17f5601b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50398eec-9c47-426e-bf0b-3e1e8ed38f55", "name": "network-vif-plugged", "status": "completed", "tag": "07fe2eb5-8d8e-4476-ac4f-3d339990371b"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:02:50.399123 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-050de5ca-ff3c-4d28-8c89-b03387b48df8 req-2b6f1bdd-48cd-4d85-bc14-836c17f5601b service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:50.399700 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-050de5ca-ff3c-4d28-8c89-b03387b48df8 req-2b6f1bdd-48cd-4d85-bc14-836c17f5601b service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:50.400763 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-050de5ca-ff3c-4d28-8c89-b03387b48df8 req-2b6f1bdd-48cd-4d85-bc14-836c17f5601b service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:50.412033 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-050de5ca-ff3c-4d28-8c89-b03387b48df8 req-2b6f1bdd-48cd-4d85-bc14-836c17f5601b service nova] Creating event network-vif-plugged:07fe2eb5-8d8e-4476-ac4f-3d339990371b for instance 50398eec-9c47-426e-bf0b-3e1e8ed38f55 on hv-cinder-85426 Aug 24 04:02:50.418665 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-050de5ca-ff3c-4d28-8c89-b03387b48df8 req-2b6f1bdd-48cd-4d85-bc14-836c17f5601b service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033215 Aug 24 04:02:50.432527 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 511/1027] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 04:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:02:50.514312 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-bce7380f-3658-498b-9a6b-ef2e063c8818 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:50.515058 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-bce7380f-3658-498b-9a6b-ef2e063c8818 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 50398eec-9c47-426e-bf0b-3e1e8ed38f55] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:50.521590 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bce7380f-3658-498b-9a6b-ef2e063c8818 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:50.522150 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bce7380f-3658-498b-9a6b-ef2e063c8818 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:50.522697 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bce7380f-3658-498b-9a6b-ef2e063c8818 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:50.523551 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bce7380f-3658-498b-9a6b-ef2e063c8818 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:50.523942 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bce7380f-3658-498b-9a6b-ef2e063c8818 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:50.524392 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bce7380f-3658-498b-9a6b-ef2e063c8818 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:50.667541 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-bce7380f-3658-498b-9a6b-ef2e063c8818 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:50.675732 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-bce7380f-3658-498b-9a6b-ef2e063c8818 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55" status: 200 len: 1266 microversion: 2.1 time: 0.166388 Aug 24 04:02:50.678983 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 517/1028] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:50 2022] GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:51.697028 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f68d38fd-404d-409e-9b1b-06f6cbaa0a78 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:51.698862 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f68d38fd-404d-409e-9b1b-06f6cbaa0a78 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 50398eec-9c47-426e-bf0b-3e1e8ed38f55] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:51.707194 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f68d38fd-404d-409e-9b1b-06f6cbaa0a78 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:51.707194 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f68d38fd-404d-409e-9b1b-06f6cbaa0a78 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:51.707194 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f68d38fd-404d-409e-9b1b-06f6cbaa0a78 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:51.707585 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f68d38fd-404d-409e-9b1b-06f6cbaa0a78 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:51.707927 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f68d38fd-404d-409e-9b1b-06f6cbaa0a78 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:51.708360 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f68d38fd-404d-409e-9b1b-06f6cbaa0a78 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:51.846065 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-f68d38fd-404d-409e-9b1b-06f6cbaa0a78 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:51.853756 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f68d38fd-404d-409e-9b1b-06f6cbaa0a78 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55" status: 200 len: 1266 microversion: 2.1 time: 0.160987 Aug 24 04:02:51.854320 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 512/1029] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:51 2022] GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:52.874244 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-db01deea-bab8-468d-abd0-937c7918b394 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:52.874864 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-db01deea-bab8-468d-abd0-937c7918b394 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 50398eec-9c47-426e-bf0b-3e1e8ed38f55] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:52.881068 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-db01deea-bab8-468d-abd0-937c7918b394 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:52.881547 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-db01deea-bab8-468d-abd0-937c7918b394 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:52.881986 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-db01deea-bab8-468d-abd0-937c7918b394 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:52.882702 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-db01deea-bab8-468d-abd0-937c7918b394 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:52.883164 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-db01deea-bab8-468d-abd0-937c7918b394 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:52.883583 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-db01deea-bab8-468d-abd0-937c7918b394 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:53.032298 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-db01deea-bab8-468d-abd0-937c7918b394 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:53.040015 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-db01deea-bab8-468d-abd0-937c7918b394 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55" status: 200 len: 1453 microversion: 2.1 time: 0.169928 Aug 24 04:02:53.040580 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 518/1030] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:52 2022] GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55 => generated 1453 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:53.060045 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c4d3126e-c351-43bd-b84c-31c8c776a000 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:53.060655 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c4d3126e-c351-43bd-b84c-31c8c776a000 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 50398eec-9c47-426e-bf0b-3e1e8ed38f55] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:53.067098 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4d3126e-c351-43bd-b84c-31c8c776a000 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:53.067583 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4d3126e-c351-43bd-b84c-31c8c776a000 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:53.068021 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4d3126e-c351-43bd-b84c-31c8c776a000 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:53.068708 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4d3126e-c351-43bd-b84c-31c8c776a000 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:53.069162 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4d3126e-c351-43bd-b84c-31c8c776a000 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:53.069665 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c4d3126e-c351-43bd-b84c-31c8c776a000 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:53.213602 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-c4d3126e-c351-43bd-b84c-31c8c776a000 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:53.221791 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c4d3126e-c351-43bd-b84c-31c8c776a000 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55" status: 200 len: 1453 microversion: 2.1 time: 0.165597 Aug 24 04:02:53.222369 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 513/1031] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:53 2022] GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55 => generated 1453 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:55.451966 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-58961244-69c3-4904-b896-bf9b8ec058ea req-1050d3c4-cb7f-485d-8cca-f4ef84743aac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50398eec-9c47-426e-bf0b-3e1e8ed38f55", "tag": "07fe2eb5-8d8e-4476-ac4f-3d339990371b"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:02:55.461915 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-58961244-69c3-4904-b896-bf9b8ec058ea req-1050d3c4-cb7f-485d-8cca-f4ef84743aac service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:55.462399 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-58961244-69c3-4904-b896-bf9b8ec058ea req-1050d3c4-cb7f-485d-8cca-f4ef84743aac service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:55.463120 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-58961244-69c3-4904-b896-bf9b8ec058ea req-1050d3c4-cb7f-485d-8cca-f4ef84743aac service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:55.474619 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-58961244-69c3-4904-b896-bf9b8ec058ea req-1050d3c4-cb7f-485d-8cca-f4ef84743aac service nova] Creating event network-changed:07fe2eb5-8d8e-4476-ac4f-3d339990371b for instance 50398eec-9c47-426e-bf0b-3e1e8ed38f55 on hv-cinder-85426 Aug 24 04:02:55.479825 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-58961244-69c3-4904-b896-bf9b8ec058ea req-1050d3c4-cb7f-485d-8cca-f4ef84743aac service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095973 Aug 24 04:02:55.480548 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 519/1032] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 04:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:03:01.989327 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-46e64d9a-580b-46c4-8d5b-d61fdaf6521c tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1282785292", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1911518088", "security_groups": [{"name": "tempest-secgroup-smoke-586775700"}], "networks": [{"uuid": "86695f32-eb94-4cb0-82d0-ad79ad71c20d"}], "block_device_mapping_v2": [{"uuid": "1ae7c177-6a5f-4d9e-ae6b-a3ec7e29b2bb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:03:02.000298 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:02.103433 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-46e64d9a-580b-46c4-8d5b-d61fdaf6521c tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] validate_networks() for [('86695f32-eb94-4cb0-82d0-ad79ad71c20d', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:03:02.536526 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-46e64d9a-580b-46c4-8d5b-d61fdaf6521c tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:03:02.536526 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-46e64d9a-580b-46c4-8d5b-d61fdaf6521c tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:03:02.536526 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-46e64d9a-580b-46c4-8d5b-d61fdaf6521c tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:03:02.536526 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-46e64d9a-580b-46c4-8d5b-d61fdaf6521c tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:03:02.536526 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-46e64d9a-580b-46c4-8d5b-d61fdaf6521c tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:03:02.545015 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46e64d9a-580b-46c4-8d5b-d61fdaf6521c tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:02.545501 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46e64d9a-580b-46c4-8d5b-d61fdaf6521c tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:02.545931 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46e64d9a-580b-46c4-8d5b-d61fdaf6521c tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:02.546679 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46e64d9a-580b-46c4-8d5b-d61fdaf6521c tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:02.547124 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46e64d9a-580b-46c4-8d5b-d61fdaf6521c tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:02.547537 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-46e64d9a-580b-46c4-8d5b-d61fdaf6521c tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:02.565257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.quota [None req-46e64d9a-580b-46c4-8d5b-d61fdaf6521c tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Getting quotas for project c4943c05bd844f8d940def9908078748. Resources: {'instances', 'cores', 'ram'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:03:02.569129 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.quota [None req-46e64d9a-580b-46c4-8d5b-d61fdaf6521c tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Getting quotas for user aa39ed4cd12348c58eef09330af9c000 and project c4943c05bd844f8d940def9908078748. Resources: {'instances', 'cores', 'ram'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:03:02.626025 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-46e64d9a-580b-46c4-8d5b-d61fdaf6521c tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:03:02.628493 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-46e64d9a-580b-46c4-8d5b-d61fdaf6521c tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1ae7c177-6a5f-4d9e-ae6b-a3ec7e29b2bb',volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:03:03.099295 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-46e64d9a-580b-46c4-8d5b-d61fdaf6521c tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.113991 Aug 24 04:03:03.100017 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 514/1033] 10.222.0.82 () {60 vars in 1147 bytes} [Wed Aug 24 04:03:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 1115 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:03:03.112723 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-3b43681d-519c-4bce-aada-cc49deed72c8 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:03.113544 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-3b43681d-519c-4bce-aada-cc49deed72c8 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:03.116736 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:03.175354 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-3b43681d-519c-4bce-aada-cc49deed72c8 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:03.182213 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-3b43681d-519c-4bce-aada-cc49deed72c8 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1089 microversion: 2.1 time: 0.074263 Aug 24 04:03:03.183505 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 520/1034] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:03:03 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1089 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:04.203508 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ccba9e6b-8cfb-42dd-96ee-2dd4f8a335cf tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:04.204117 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ccba9e6b-8cfb-42dd-96ee-2dd4f8a335cf tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:04.210756 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ccba9e6b-8cfb-42dd-96ee-2dd4f8a335cf tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:04.211240 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ccba9e6b-8cfb-42dd-96ee-2dd4f8a335cf tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:04.211775 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ccba9e6b-8cfb-42dd-96ee-2dd4f8a335cf tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:04.212778 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ccba9e6b-8cfb-42dd-96ee-2dd4f8a335cf tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:04.213466 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ccba9e6b-8cfb-42dd-96ee-2dd4f8a335cf tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:04.213890 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ccba9e6b-8cfb-42dd-96ee-2dd4f8a335cf tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:04.216564 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=49 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:04.277189 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-ccba9e6b-8cfb-42dd-96ee-2dd4f8a335cf tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:04.291119 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ccba9e6b-8cfb-42dd-96ee-2dd4f8a335cf tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1139 microversion: 2.1 time: 0.090815 Aug 24 04:03:04.292167 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 515/1035] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:03:04 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1139 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:05.315145 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-caae7d93-028c-487f-a596-dbb7b0a74fc4 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:05.315806 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-caae7d93-028c-487f-a596-dbb7b0a74fc4 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:05.323278 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-caae7d93-028c-487f-a596-dbb7b0a74fc4 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:05.323763 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-caae7d93-028c-487f-a596-dbb7b0a74fc4 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:05.324196 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-caae7d93-028c-487f-a596-dbb7b0a74fc4 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:05.324888 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-caae7d93-028c-487f-a596-dbb7b0a74fc4 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:05.325338 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-caae7d93-028c-487f-a596-dbb7b0a74fc4 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:05.325756 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-caae7d93-028c-487f-a596-dbb7b0a74fc4 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:05.328453 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell1:SELECT=65 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:05.409027 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-caae7d93-028c-487f-a596-dbb7b0a74fc4 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:05.417902 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-caae7d93-028c-487f-a596-dbb7b0a74fc4 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1195 microversion: 2.1 time: 0.106622 Aug 24 04:03:05.418481 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 521/1036] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:03:05 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1195 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:06.441593 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d4dec2fc-7d2e-48f0-b601-c3f3ee93131e tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:06.442840 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d4dec2fc-7d2e-48f0-b601-c3f3ee93131e tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:06.445179 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=4 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:06.451193 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d4dec2fc-7d2e-48f0-b601-c3f3ee93131e tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:06.451685 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d4dec2fc-7d2e-48f0-b601-c3f3ee93131e tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:06.452130 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d4dec2fc-7d2e-48f0-b601-c3f3ee93131e tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:06.452878 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d4dec2fc-7d2e-48f0-b601-c3f3ee93131e tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:06.453387 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d4dec2fc-7d2e-48f0-b601-c3f3ee93131e tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:06.453819 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d4dec2fc-7d2e-48f0-b601-c3f3ee93131e tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:06.597597 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-d4dec2fc-7d2e-48f0-b601-c3f3ee93131e tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:06.605849 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d4dec2fc-7d2e-48f0-b601-c3f3ee93131e tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1272 microversion: 2.1 time: 0.168336 Aug 24 04:03:06.606424 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 516/1037] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:03:06 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1272 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:07.209791 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-37a1e793-92ac-4185-9502-8ccd67956d05 req-704789ad-1721-4943-aea5-f161f2acf3cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a594d5f2-3dd6-44f5-88bb-56396538864b", "tag": "3f135d8e-5df6-49a2-8a9b-f5b220e13806"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:03:07.219306 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-37a1e793-92ac-4185-9502-8ccd67956d05 req-704789ad-1721-4943-aea5-f161f2acf3cb service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:07.224600 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-37a1e793-92ac-4185-9502-8ccd67956d05 req-704789ad-1721-4943-aea5-f161f2acf3cb service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:07.224600 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-37a1e793-92ac-4185-9502-8ccd67956d05 req-704789ad-1721-4943-aea5-f161f2acf3cb service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:07.232442 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-37a1e793-92ac-4185-9502-8ccd67956d05 req-704789ad-1721-4943-aea5-f161f2acf3cb service nova] Creating event network-changed:3f135d8e-5df6-49a2-8a9b-f5b220e13806 for instance a594d5f2-3dd6-44f5-88bb-56396538864b on hv-cinder-85426 Aug 24 04:03:07.237222 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-37a1e793-92ac-4185-9502-8ccd67956d05 req-704789ad-1721-4943-aea5-f161f2acf3cb service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090841 Aug 24 04:03:07.237821 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 522/1038] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 04:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:03:07.630609 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bd46d92d-133b-47bf-9820-6bbb87fc3323 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:07.631259 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bd46d92d-133b-47bf-9820-6bbb87fc3323 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:07.637947 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bd46d92d-133b-47bf-9820-6bbb87fc3323 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:07.638433 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bd46d92d-133b-47bf-9820-6bbb87fc3323 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:07.638898 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bd46d92d-133b-47bf-9820-6bbb87fc3323 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:07.639618 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bd46d92d-133b-47bf-9820-6bbb87fc3323 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:07.640072 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bd46d92d-133b-47bf-9820-6bbb87fc3323 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:07.640492 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bd46d92d-133b-47bf-9820-6bbb87fc3323 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:07.784968 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-bd46d92d-133b-47bf-9820-6bbb87fc3323 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:07.793331 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bd46d92d-133b-47bf-9820-6bbb87fc3323 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1260 microversion: 2.1 time: 0.166838 Aug 24 04:03:07.793851 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 517/1039] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:03:07 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:08.814628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-9d0d4d03-a3b6-411c-8738-49b0fceb4f21 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:08.815323 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-9d0d4d03-a3b6-411c-8738-49b0fceb4f21 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:08.821544 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9d0d4d03-a3b6-411c-8738-49b0fceb4f21 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:08.822208 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9d0d4d03-a3b6-411c-8738-49b0fceb4f21 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:08.822673 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9d0d4d03-a3b6-411c-8738-49b0fceb4f21 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:08.823362 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9d0d4d03-a3b6-411c-8738-49b0fceb4f21 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:08.823812 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9d0d4d03-a3b6-411c-8738-49b0fceb4f21 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:08.824230 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9d0d4d03-a3b6-411c-8738-49b0fceb4f21 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:08.965457 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-9d0d4d03-a3b6-411c-8738-49b0fceb4f21 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:08.973068 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-9d0d4d03-a3b6-411c-8738-49b0fceb4f21 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1260 microversion: 2.1 time: 0.163314 Aug 24 04:03:08.973648 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 523/1040] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:03:08 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:09.995906 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-a1f254dd-76b9-408e-a199-3528bb10b007 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:09.996641 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-a1f254dd-76b9-408e-a199-3528bb10b007 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:10.003499 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a1f254dd-76b9-408e-a199-3528bb10b007 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:10.003982 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a1f254dd-76b9-408e-a199-3528bb10b007 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:10.004440 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a1f254dd-76b9-408e-a199-3528bb10b007 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:10.005114 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a1f254dd-76b9-408e-a199-3528bb10b007 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:10.006007 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a1f254dd-76b9-408e-a199-3528bb10b007 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:10.006754 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-a1f254dd-76b9-408e-a199-3528bb10b007 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:10.142183 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-a1f254dd-76b9-408e-a199-3528bb10b007 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:10.150346 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-a1f254dd-76b9-408e-a199-3528bb10b007 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1260 microversion: 2.1 time: 0.158953 Aug 24 04:03:10.150952 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 518/1041] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:03:09 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:11.170136 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-b9c3e55a-f0de-4aea-9b4e-dd6a360eb5ef tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:11.170790 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-b9c3e55a-f0de-4aea-9b4e-dd6a360eb5ef tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:11.177194 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b9c3e55a-f0de-4aea-9b4e-dd6a360eb5ef tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:11.177677 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b9c3e55a-f0de-4aea-9b4e-dd6a360eb5ef tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:11.178103 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b9c3e55a-f0de-4aea-9b4e-dd6a360eb5ef tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:11.178962 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b9c3e55a-f0de-4aea-9b4e-dd6a360eb5ef tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:11.179404 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b9c3e55a-f0de-4aea-9b4e-dd6a360eb5ef tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:11.179819 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b9c3e55a-f0de-4aea-9b4e-dd6a360eb5ef tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:11.312085 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-b9c3e55a-f0de-4aea-9b4e-dd6a360eb5ef tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:11.319914 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-b9c3e55a-f0de-4aea-9b4e-dd6a360eb5ef tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1260 microversion: 2.1 time: 0.153715 Aug 24 04:03:11.324634 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 524/1042] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:03:11 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:12.344132 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-6bc52aba-26d0-48e6-8f27-c4dd9ec71713 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:12.344747 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-6bc52aba-26d0-48e6-8f27-c4dd9ec71713 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:12.351710 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6bc52aba-26d0-48e6-8f27-c4dd9ec71713 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:12.352191 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6bc52aba-26d0-48e6-8f27-c4dd9ec71713 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:12.352648 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6bc52aba-26d0-48e6-8f27-c4dd9ec71713 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:12.353358 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6bc52aba-26d0-48e6-8f27-c4dd9ec71713 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:12.353808 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6bc52aba-26d0-48e6-8f27-c4dd9ec71713 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:12.354228 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-6bc52aba-26d0-48e6-8f27-c4dd9ec71713 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:12.500686 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-6bc52aba-26d0-48e6-8f27-c4dd9ec71713 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:12.509985 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-6bc52aba-26d0-48e6-8f27-c4dd9ec71713 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1260 microversion: 2.1 time: 0.170407 Aug 24 04:03:12.510768 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 519/1043] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:03:12 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:13.530929 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-9b8bbc69-d10e-401b-97f4-efd6989cd39d tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:13.531527 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-9b8bbc69-d10e-401b-97f4-efd6989cd39d tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:13.533943 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell0:SELECT=2 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:13.538724 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9b8bbc69-d10e-401b-97f4-efd6989cd39d tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:13.539208 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9b8bbc69-d10e-401b-97f4-efd6989cd39d tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:13.539635 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9b8bbc69-d10e-401b-97f4-efd6989cd39d tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:13.541759 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9b8bbc69-d10e-401b-97f4-efd6989cd39d tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:13.542239 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9b8bbc69-d10e-401b-97f4-efd6989cd39d tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:13.542725 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9b8bbc69-d10e-401b-97f4-efd6989cd39d tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:13.678758 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-9b8bbc69-d10e-401b-97f4-efd6989cd39d tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:13.686626 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-9b8bbc69-d10e-401b-97f4-efd6989cd39d tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1260 microversion: 2.1 time: 0.159766 Aug 24 04:03:13.687192 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 525/1044] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:03:13 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:03:14.707384 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f2e9f3e1-6bec-4d11-9308-13806602741e tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:14.707997 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f2e9f3e1-6bec-4d11-9308-13806602741e tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:14.709836 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:14.710641 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:14.716164 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f2e9f3e1-6bec-4d11-9308-13806602741e tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:14.716650 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f2e9f3e1-6bec-4d11-9308-13806602741e tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:14.717079 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f2e9f3e1-6bec-4d11-9308-13806602741e tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:14.717760 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f2e9f3e1-6bec-4d11-9308-13806602741e tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:14.718206 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f2e9f3e1-6bec-4d11-9308-13806602741e tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:14.718656 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f2e9f3e1-6bec-4d11-9308-13806602741e tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:14.850605 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-f2e9f3e1-6bec-4d11-9308-13806602741e tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:14.859148 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f2e9f3e1-6bec-4d11-9308-13806602741e tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1260 microversion: 2.1 time: 0.155614 Aug 24 04:03:14.859715 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 520/1045] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:03:14 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:15.880929 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-b5458690-a4a3-4d6a-b1d5-743716d1b3c2 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:15.881485 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-b5458690-a4a3-4d6a-b1d5-743716d1b3c2 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:15.888624 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b5458690-a4a3-4d6a-b1d5-743716d1b3c2 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:15.889105 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b5458690-a4a3-4d6a-b1d5-743716d1b3c2 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:15.889539 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b5458690-a4a3-4d6a-b1d5-743716d1b3c2 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:15.890228 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b5458690-a4a3-4d6a-b1d5-743716d1b3c2 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:15.890722 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b5458690-a4a3-4d6a-b1d5-743716d1b3c2 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:15.891148 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-b5458690-a4a3-4d6a-b1d5-743716d1b3c2 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:16.023852 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-b5458690-a4a3-4d6a-b1d5-743716d1b3c2 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:16.032228 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-b5458690-a4a3-4d6a-b1d5-743716d1b3c2 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1260 microversion: 2.1 time: 0.155577 Aug 24 04:03:16.033010 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 526/1046] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:03:15 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:17.053226 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-cdf14088-0c04-4ea2-809e-2cfd19f40d57 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:17.056125 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-cdf14088-0c04-4ea2-809e-2cfd19f40d57 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:17.062376 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cdf14088-0c04-4ea2-809e-2cfd19f40d57 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:17.062881 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cdf14088-0c04-4ea2-809e-2cfd19f40d57 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:17.063309 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cdf14088-0c04-4ea2-809e-2cfd19f40d57 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:17.064038 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cdf14088-0c04-4ea2-809e-2cfd19f40d57 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:17.064493 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cdf14088-0c04-4ea2-809e-2cfd19f40d57 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:17.064909 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-cdf14088-0c04-4ea2-809e-2cfd19f40d57 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:17.199749 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-cdf14088-0c04-4ea2-809e-2cfd19f40d57 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:17.207211 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-cdf14088-0c04-4ea2-809e-2cfd19f40d57 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1260 microversion: 2.1 time: 0.157817 Aug 24 04:03:17.207786 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 521/1047] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:03:17 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:18.228925 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-ae8d3aa4-784d-4057-ac5c-fc2e34862688 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:18.229437 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-ae8d3aa4-784d-4057-ac5c-fc2e34862688 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:18.235880 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ae8d3aa4-784d-4057-ac5c-fc2e34862688 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:18.236358 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ae8d3aa4-784d-4057-ac5c-fc2e34862688 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:18.236788 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ae8d3aa4-784d-4057-ac5c-fc2e34862688 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:18.237467 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ae8d3aa4-784d-4057-ac5c-fc2e34862688 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:18.237913 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ae8d3aa4-784d-4057-ac5c-fc2e34862688 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:18.238333 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ae8d3aa4-784d-4057-ac5c-fc2e34862688 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:18.373097 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-ae8d3aa4-784d-4057-ac5c-fc2e34862688 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:18.380975 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-ae8d3aa4-784d-4057-ac5c-fc2e34862688 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1260 microversion: 2.1 time: 0.156839 Aug 24 04:03:18.381537 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 527/1048] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:03:18 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:18.563683 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-cb9c8c87-f155-4198-9156-45a162f426c5 req-c4c42d70-bc55-43c1-9e76-694ef89cb363 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a594d5f2-3dd6-44f5-88bb-56396538864b", "name": "network-vif-plugged", "status": "completed", "tag": "3f135d8e-5df6-49a2-8a9b-f5b220e13806"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:03:18.578234 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-cb9c8c87-f155-4198-9156-45a162f426c5 req-c4c42d70-bc55-43c1-9e76-694ef89cb363 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:18.579937 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-cb9c8c87-f155-4198-9156-45a162f426c5 req-c4c42d70-bc55-43c1-9e76-694ef89cb363 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:18.579937 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-cb9c8c87-f155-4198-9156-45a162f426c5 req-c4c42d70-bc55-43c1-9e76-694ef89cb363 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:18.591083 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-cb9c8c87-f155-4198-9156-45a162f426c5 req-c4c42d70-bc55-43c1-9e76-694ef89cb363 service nova] Creating event network-vif-plugged:3f135d8e-5df6-49a2-8a9b-f5b220e13806 for instance a594d5f2-3dd6-44f5-88bb-56396538864b on hv-cinder-85426 Aug 24 04:03:18.596134 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-cb9c8c87-f155-4198-9156-45a162f426c5 req-c4c42d70-bc55-43c1-9e76-694ef89cb363 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093732 Aug 24 04:03:18.596734 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 522/1049] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 04:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:03:19.406754 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-267f95aa-bed1-45f6-bc43-04d62841f866 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:19.407354 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-267f95aa-bed1-45f6-bc43-04d62841f866 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:19.413918 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-267f95aa-bed1-45f6-bc43-04d62841f866 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:19.414405 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-267f95aa-bed1-45f6-bc43-04d62841f866 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:19.418867 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-267f95aa-bed1-45f6-bc43-04d62841f866 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:19.418867 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-267f95aa-bed1-45f6-bc43-04d62841f866 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:19.418867 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-267f95aa-bed1-45f6-bc43-04d62841f866 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:19.418867 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-267f95aa-bed1-45f6-bc43-04d62841f866 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:19.556560 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-267f95aa-bed1-45f6-bc43-04d62841f866 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:19.564491 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-267f95aa-bed1-45f6-bc43-04d62841f866 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1260 microversion: 2.1 time: 0.161724 Aug 24 04:03:19.565062 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 528/1050] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:03:19 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:20.587770 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-ed74bfba-d9ea-4de8-a4db-0b2d6930b819 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:20.588459 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-ed74bfba-d9ea-4de8-a4db-0b2d6930b819 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:20.594775 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed74bfba-d9ea-4de8-a4db-0b2d6930b819 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:20.598829 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed74bfba-d9ea-4de8-a4db-0b2d6930b819 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:20.598829 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed74bfba-d9ea-4de8-a4db-0b2d6930b819 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:20.598829 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed74bfba-d9ea-4de8-a4db-0b2d6930b819 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:20.598829 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed74bfba-d9ea-4de8-a4db-0b2d6930b819 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:20.599237 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-ed74bfba-d9ea-4de8-a4db-0b2d6930b819 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:20.735736 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-ed74bfba-d9ea-4de8-a4db-0b2d6930b819 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:20.744246 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-ed74bfba-d9ea-4de8-a4db-0b2d6930b819 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1443 microversion: 2.1 time: 0.161425 Aug 24 04:03:20.744815 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 523/1051] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:03:20 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1443 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:20.764601 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-735d9c32-dd71-4e88-bab0-ead162b3f66d tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:20.765221 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-735d9c32-dd71-4e88-bab0-ead162b3f66d tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:20.771622 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-735d9c32-dd71-4e88-bab0-ead162b3f66d tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:20.772101 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-735d9c32-dd71-4e88-bab0-ead162b3f66d tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:20.772534 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-735d9c32-dd71-4e88-bab0-ead162b3f66d tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:20.773216 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-735d9c32-dd71-4e88-bab0-ead162b3f66d tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:20.773664 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-735d9c32-dd71-4e88-bab0-ead162b3f66d tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:20.774111 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-735d9c32-dd71-4e88-bab0-ead162b3f66d tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:21.142739 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-735d9c32-dd71-4e88-bab0-ead162b3f66d tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:21.150952 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-735d9c32-dd71-4e88-bab0-ead162b3f66d tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1443 microversion: 2.1 time: 0.390209 Aug 24 04:03:21.151508 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 529/1052] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:03:20 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1443 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:23.161157 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-28406564-41ca-4160-9ced-72c8589f8c42 req-5e3283d3-ddd8-4e2d-b0bc-52553641d343 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a594d5f2-3dd6-44f5-88bb-56396538864b", "tag": "3f135d8e-5df6-49a2-8a9b-f5b220e13806"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:03:23.171892 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-28406564-41ca-4160-9ced-72c8589f8c42 req-5e3283d3-ddd8-4e2d-b0bc-52553641d343 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:23.172367 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-28406564-41ca-4160-9ced-72c8589f8c42 req-5e3283d3-ddd8-4e2d-b0bc-52553641d343 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:23.172788 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-28406564-41ca-4160-9ced-72c8589f8c42 req-5e3283d3-ddd8-4e2d-b0bc-52553641d343 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:23.183797 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-28406564-41ca-4160-9ced-72c8589f8c42 req-5e3283d3-ddd8-4e2d-b0bc-52553641d343 service nova] Creating event network-changed:3f135d8e-5df6-49a2-8a9b-f5b220e13806 for instance a594d5f2-3dd6-44f5-88bb-56396538864b on hv-cinder-85426 Aug 24 04:03:23.188824 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-28406564-41ca-4160-9ced-72c8589f8c42 req-5e3283d3-ddd8-4e2d-b0bc-52553641d343 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031696 Aug 24 04:03:23.189400 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 524/1053] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 04:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:04:52.586031 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_api:SELECT=21 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:04:52.586824 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell1:SELECT=49 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:04:52.590854 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-2486604e-a498-4781-807d-29425cc2460b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:52.591371 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-2486604e-a498-4781-807d-29425cc2460b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 50398eec-9c47-426e-bf0b-3e1e8ed38f55] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:52.597228 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2486604e-a498-4781-807d-29425cc2460b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:52.597699 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2486604e-a498-4781-807d-29425cc2460b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:52.601113 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2486604e-a498-4781-807d-29425cc2460b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:52.601113 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2486604e-a498-4781-807d-29425cc2460b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:52.601113 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2486604e-a498-4781-807d-29425cc2460b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:52.601113 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2486604e-a498-4781-807d-29425cc2460b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:52.625388 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-2486604e-a498-4781-807d-29425cc2460b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 50398eec-9c47-426e-bf0b-3e1e8ed38f55] Going to try to terminate instance {{(pid=127869) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:04:52.995897 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-2486604e-a498-4781-807d-29425cc2460b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "DELETE /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55" status: 204 len: 0 microversion: 2.1 time: 0.411354 Aug 24 04:04:52.996477 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 530/1054] 10.222.0.82 () {58 vars in 1239 bytes} [Wed Aug 24 04:04:52 2022] DELETE /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:04:53.003580 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=17 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:04:53.006236 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=51 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:04:53.009067 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4aa115bd-19d1-42fd-a64f-72cfc9408403 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:53.009766 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4aa115bd-19d1-42fd-a64f-72cfc9408403 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 50398eec-9c47-426e-bf0b-3e1e8ed38f55] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:53.015832 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4aa115bd-19d1-42fd-a64f-72cfc9408403 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:53.016315 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4aa115bd-19d1-42fd-a64f-72cfc9408403 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:53.016747 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4aa115bd-19d1-42fd-a64f-72cfc9408403 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:53.017440 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4aa115bd-19d1-42fd-a64f-72cfc9408403 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:53.017970 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4aa115bd-19d1-42fd-a64f-72cfc9408403 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:53.018425 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4aa115bd-19d1-42fd-a64f-72cfc9408403 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:53.158442 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-4aa115bd-19d1-42fd-a64f-72cfc9408403 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:53.166826 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4aa115bd-19d1-42fd-a64f-72cfc9408403 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55" status: 200 len: 1578 microversion: 2.1 time: 0.165613 Aug 24 04:04:53.167390 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 525/1055] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:52 2022] GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55 => generated 1578 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:04:54.189371 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-ce2fcddc-94f8-4ae9-8eae-9accb291c46c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:54.190075 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-ce2fcddc-94f8-4ae9-8eae-9accb291c46c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 50398eec-9c47-426e-bf0b-3e1e8ed38f55] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:54.196654 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ce2fcddc-94f8-4ae9-8eae-9accb291c46c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:54.197131 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ce2fcddc-94f8-4ae9-8eae-9accb291c46c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:54.197564 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ce2fcddc-94f8-4ae9-8eae-9accb291c46c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:54.198244 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ce2fcddc-94f8-4ae9-8eae-9accb291c46c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:54.198727 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ce2fcddc-94f8-4ae9-8eae-9accb291c46c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:54.199150 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ce2fcddc-94f8-4ae9-8eae-9accb291c46c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:54.332364 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-ce2fcddc-94f8-4ae9-8eae-9accb291c46c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:54.340684 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-ce2fcddc-94f8-4ae9-8eae-9accb291c46c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55" status: 200 len: 1578 microversion: 2.1 time: 0.155549 Aug 24 04:04:54.341252 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 531/1056] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:54 2022] GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55 => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:04:55.360924 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-baf553d6-5cf1-4f85-80dc-c931048be36c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:55.361550 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-baf553d6-5cf1-4f85-80dc-c931048be36c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 50398eec-9c47-426e-bf0b-3e1e8ed38f55] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:55.367928 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-baf553d6-5cf1-4f85-80dc-c931048be36c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:55.368406 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-baf553d6-5cf1-4f85-80dc-c931048be36c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:55.368839 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-baf553d6-5cf1-4f85-80dc-c931048be36c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:55.369523 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-baf553d6-5cf1-4f85-80dc-c931048be36c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:55.369975 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-baf553d6-5cf1-4f85-80dc-c931048be36c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:55.370395 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-baf553d6-5cf1-4f85-80dc-c931048be36c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:55.481937 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-baf553d6-5cf1-4f85-80dc-c931048be36c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:55.481937 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-baf553d6-5cf1-4f85-80dc-c931048be36c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55" status: 200 len: 1510 microversion: 2.1 time: 0.088189 Aug 24 04:04:55.481937 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 526/1057] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:55 2022] GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55 => generated 1510 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:04:55.703305 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-19399b04-b407-493e-8de5-4d720477a38e req-c72e789a-16f4-43a6-ac89-f0aae3afbd68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50398eec-9c47-426e-bf0b-3e1e8ed38f55", "name": "network-vif-deleted", "tag": "07fe2eb5-8d8e-4476-ac4f-3d339990371b"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:04:55.715485 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-19399b04-b407-493e-8de5-4d720477a38e req-c72e789a-16f4-43a6-ac89-f0aae3afbd68 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:55.715485 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-19399b04-b407-493e-8de5-4d720477a38e req-c72e789a-16f4-43a6-ac89-f0aae3afbd68 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:55.715485 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-19399b04-b407-493e-8de5-4d720477a38e req-c72e789a-16f4-43a6-ac89-f0aae3afbd68 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:55.728155 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-19399b04-b407-493e-8de5-4d720477a38e req-c72e789a-16f4-43a6-ac89-f0aae3afbd68 service nova] Creating event network-vif-deleted:07fe2eb5-8d8e-4476-ac4f-3d339990371b for instance 50398eec-9c47-426e-bf0b-3e1e8ed38f55 on hv-cinder-85426 Aug 24 04:04:55.733217 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-19399b04-b407-493e-8de5-4d720477a38e req-c72e789a-16f4-43a6-ac89-f0aae3afbd68 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033631 Aug 24 04:04:55.733981 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 532/1058] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 04:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:04:56.467039 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f54cdbf4-844d-47b6-967c-8e0cb38e1ae1 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:56.467648 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f54cdbf4-844d-47b6-967c-8e0cb38e1ae1 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 50398eec-9c47-426e-bf0b-3e1e8ed38f55] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:56.474372 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f54cdbf4-844d-47b6-967c-8e0cb38e1ae1 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:56.474887 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f54cdbf4-844d-47b6-967c-8e0cb38e1ae1 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:56.475318 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f54cdbf4-844d-47b6-967c-8e0cb38e1ae1 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:56.476088 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f54cdbf4-844d-47b6-967c-8e0cb38e1ae1 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:56.476621 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f54cdbf4-844d-47b6-967c-8e0cb38e1ae1 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:56.477041 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f54cdbf4-844d-47b6-967c-8e0cb38e1ae1 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:56.511532 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f54cdbf4-844d-47b6-967c-8e0cb38e1ae1 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:56.512008 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f54cdbf4-844d-47b6-967c-8e0cb38e1ae1 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:56.512444 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f54cdbf4-844d-47b6-967c-8e0cb38e1ae1 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:56.512889 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-f54cdbf4-844d-47b6-967c-8e0cb38e1ae1 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lazy-loading 'fault' on Instance uuid 50398eec-9c47-426e-bf0b-3e1e8ed38f55 {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:04:56.563067 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-f54cdbf4-844d-47b6-967c-8e0cb38e1ae1 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:56.571745 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f54cdbf4-844d-47b6-967c-8e0cb38e1ae1 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55" status: 200 len: 1230 microversion: 2.1 time: 0.108686 Aug 24 04:04:56.573476 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 527/1059] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:56 2022] GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55 => generated 1230 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:04:57.593749 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-f1a8de03-143d-4cd8-934d-28259233cf6d tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:57.594443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-f1a8de03-143d-4cd8-934d-28259233cf6d tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 50398eec-9c47-426e-bf0b-3e1e8ed38f55] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:57.601118 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f1a8de03-143d-4cd8-934d-28259233cf6d tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:57.601702 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f1a8de03-143d-4cd8-934d-28259233cf6d tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:57.602132 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f1a8de03-143d-4cd8-934d-28259233cf6d tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:57.603158 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f1a8de03-143d-4cd8-934d-28259233cf6d tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:57.603618 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f1a8de03-143d-4cd8-934d-28259233cf6d tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:57.604245 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f1a8de03-143d-4cd8-934d-28259233cf6d tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:57.625768 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.wsgi [None req-f1a8de03-143d-4cd8-934d-28259233cf6d tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] HTTP exception thrown: Instance 50398eec-9c47-426e-bf0b-3e1e8ed38f55 could not be found. Aug 24 04:04:57.627443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-f1a8de03-143d-4cd8-934d-28259233cf6d tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Request method failure captured: Aug 24 04:04:57.627443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: request: GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55 HTTP/1.1 Aug 24 04:04:57.627443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept: application/json Aug 24 04:04:57.627443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept-Encoding: identity Aug 24 04:04:57.627443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Connection: close Aug 24 04:04:57.627443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Length: 0 Aug 24 04:04:57.627443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Type: application/json Aug 24 04:04:57.627443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Host: 10.222.0.82 Aug 24 04:04:57.627443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Openstack-System-Scope: None Aug 24 04:04:57.627443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: User-Agent: python-urllib3/1.26.11 Aug 24 04:04:57.627443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Auth-Token: gAAAAABjBaK674QuAsdsIy7jRfgDNmoTzChvjwsgjWf_IBSa90n_BCEIeO6wVcFMf7aCdbHPnt8SInM4y4J-T7NCWS0JsD3SUrC6jr2qQmCLsvy_w7njCxyW3gzpGPGLOuABIGSctaY6-CBYSGx_bvbe1R42jqqJTN0CtxAD2loqE5FkuTr5QF8 Aug 24 04:04:57.627443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Id: None Aug 24 04:04:57.627443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Name: None Aug 24 04:04:57.627443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Identity-Status: Confirmed Aug 24 04:04:57.627443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Is-Admin-Project: True Aug 24 04:04:57.627443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Id: default Aug 24 04:04:57.627443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Name: Default Aug 24 04:04:57.627443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Id: 8d390e7ad1454a8182258cd72bea4fa5 Aug 24 04:04:57.627443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Name: tempest-TestVolumeBootPattern-2114603980 Aug 24 04:04:57.627443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Role: member,reader Aug 24 04:04:57.627443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Roles: member,reader Aug 24 04:04:57.629502 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/8d390e7ad1454a8182258cd72bea4fa5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/8d390e7ad1454a8182258cd72bea4fa5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/8d390e7ad1454a8182258cd72bea4fa5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_8d390e7ad1454a8182258cd72bea4fa5", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 04:04:57.629502 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant: tempest-TestVolumeBootPattern-2114603980 Aug 24 04:04:57.629502 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Id: 8d390e7ad1454a8182258cd72bea4fa5 Aug 24 04:04:57.629502 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Name: tempest-TestVolumeBootPattern-2114603980 Aug 24 04:04:57.629502 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User: tempest-TestVolumeBootPattern-2114603980-project Aug 24 04:04:57.629502 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Id: default Aug 24 04:04:57.629502 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Name: Default Aug 24 04:04:57.629502 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Id: 34d452ce6a1245c192acf8c87651fe92 Aug 24 04:04:57.629502 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Name: tempest-TestVolumeBootPattern-2114603980-project Aug 24 04:04:57.629502 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: method: > Aug 24 04:04:57.629502 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: exception: Instance 50398eec-9c47-426e-bf0b-3e1e8ed38f55 could not be found. Aug 24 04:04:57.629502 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: action_args: {'id': '50398eec-9c47-426e-bf0b-3e1e8ed38f55'} Aug 24 04:04:57.630544 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:04:57.630544 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:57.630544 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:04:57.630544 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:04:57.630544 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:04:57.630544 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:04:57.630544 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:04:57.630544 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:04:57.630544 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:04:57.630544 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:04:57.630544 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50398eec-9c47-426e-bf0b-3e1e8ed38f55 could not be found. Aug 24 04:04:57.630544 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 04:04:57.630544 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:04:57.630544 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 04:04:57.630544 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:57.630544 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:04:57.630544 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:04:57.630544 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:04:57.630544 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:04:57.630544 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:04:57.633048 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:04:57.633048 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:04:57.633048 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:04:57.633048 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:04:57.633048 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:04:57.633048 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:04:57.633048 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:04:57.633048 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50398eec-9c47-426e-bf0b-3e1e8ed38f55 could not be found. Aug 24 04:04:57.633048 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 04:04:57.633048 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:04:57.633048 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 04:04:57.633048 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:57.633048 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:04:57.633048 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:04:57.633048 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:04:57.633048 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:04:57.633048 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50398eec-9c47-426e-bf0b-3e1e8ed38f55 could not be found. Aug 24 04:04:57.633048 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 04:04:57.634494 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-f1a8de03-143d-4cd8-934d-28259233cf6d tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Returning 404 to user: Instance 50398eec-9c47-426e-bf0b-3e1e8ed38f55 could not be found. {{(pid=127869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:04:57.634494 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-f1a8de03-143d-4cd8-934d-28259233cf6d tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55" status: 404 len: 111 microversion: 2.1 time: 0.040036 Aug 24 04:04:57.634494 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 533/1060] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:57 2022] GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:04:57.725447 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-d7ecd30b-ad0d-4c68-a33a-8f028b4fd380 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1728673921", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-166112542", "security_groups": [{"name": "tempest-secgroup-smoke-1291274157"}], "block_device_mapping_v2": [{"uuid": "b597d5be-ebfe-458a-a141-b5287e46c1c0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "01c2e76d-69cf-4147-aee5-37246a863c64"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:04:57.840110 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-d7ecd30b-ad0d-4c68-a33a-8f028b4fd380 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] validate_networks() for [('01c2e76d-69cf-4147-aee5-37246a863c64', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:04:58.213877 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-d7ecd30b-ad0d-4c68-a33a-8f028b4fd380 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:04:58.214327 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-d7ecd30b-ad0d-4c68-a33a-8f028b4fd380 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:04:58.214817 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-d7ecd30b-ad0d-4c68-a33a-8f028b4fd380 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:04:58.215223 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-d7ecd30b-ad0d-4c68-a33a-8f028b4fd380 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:04:58.215628 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-d7ecd30b-ad0d-4c68-a33a-8f028b4fd380 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:04:58.225118 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d7ecd30b-ad0d-4c68-a33a-8f028b4fd380 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:58.225594 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d7ecd30b-ad0d-4c68-a33a-8f028b4fd380 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:58.226029 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d7ecd30b-ad0d-4c68-a33a-8f028b4fd380 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:58.226789 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d7ecd30b-ad0d-4c68-a33a-8f028b4fd380 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:58.227247 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d7ecd30b-ad0d-4c68-a33a-8f028b4fd380 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:58.227674 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-d7ecd30b-ad0d-4c68-a33a-8f028b4fd380 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:58.244783 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.quota [None req-d7ecd30b-ad0d-4c68-a33a-8f028b4fd380 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Getting quotas for project 8d390e7ad1454a8182258cd72bea4fa5. Resources: {'instances', 'cores', 'ram'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:04:58.248687 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.quota [None req-d7ecd30b-ad0d-4c68-a33a-8f028b4fd380 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Getting quotas for user 34d452ce6a1245c192acf8c87651fe92 and project 8d390e7ad1454a8182258cd72bea4fa5. Resources: {'instances', 'cores', 'ram'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:04:58.306269 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d7ecd30b-ad0d-4c68-a33a-8f028b4fd380 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:04:58.313852 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-d7ecd30b-ad0d-4c68-a33a-8f028b4fd380 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 3ae1189b-ce08-4b70-9eaa-e7c9efb191a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b597d5be-ebfe-458a-a141-b5287e46c1c0',volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:04:58.759001 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-d7ecd30b-ad0d-4c68-a33a-8f028b4fd380 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.037413 Aug 24 04:04:58.759987 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 528/1061] 10.222.0.82 () {60 vars in 1147 bytes} [Wed Aug 24 04:04:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 1039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:04:58.770597 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-cee9dd68-c8f1-4202-b70a-ea19b9286499 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:58.771305 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-cee9dd68-c8f1-4202-b70a-ea19b9286499 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 3ae1189b-ce08-4b70-9eaa-e7c9efb191a2] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:58.835192 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-cee9dd68-c8f1-4202-b70a-ea19b9286499 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:58.842857 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-cee9dd68-c8f1-4202-b70a-ea19b9286499 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2" status: 200 len: 1094 microversion: 2.1 time: 0.076113 Aug 24 04:04:58.843456 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 534/1062] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:58 2022] GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2 => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:04:59.863407 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2c5567f3-22f9-4b78-8d02-7b2d28dbd546 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:59.864141 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2c5567f3-22f9-4b78-8d02-7b2d28dbd546 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 3ae1189b-ce08-4b70-9eaa-e7c9efb191a2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:59.870307 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c5567f3-22f9-4b78-8d02-7b2d28dbd546 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:59.870823 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c5567f3-22f9-4b78-8d02-7b2d28dbd546 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:59.871257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c5567f3-22f9-4b78-8d02-7b2d28dbd546 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:59.871946 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c5567f3-22f9-4b78-8d02-7b2d28dbd546 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:59.872396 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c5567f3-22f9-4b78-8d02-7b2d28dbd546 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:59.872819 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2c5567f3-22f9-4b78-8d02-7b2d28dbd546 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:59.933913 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-2c5567f3-22f9-4b78-8d02-7b2d28dbd546 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:59.941706 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2c5567f3-22f9-4b78-8d02-7b2d28dbd546 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2" status: 200 len: 1144 microversion: 2.1 time: 0.082761 Aug 24 04:04:59.942269 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 529/1063] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:59 2022] GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2 => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:00.963661 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-16df1865-426b-43df-8440-faa77cd4c67b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:00.965013 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-16df1865-426b-43df-8440-faa77cd4c67b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 3ae1189b-ce08-4b70-9eaa-e7c9efb191a2] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:00.972382 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-16df1865-426b-43df-8440-faa77cd4c67b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:00.973137 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-16df1865-426b-43df-8440-faa77cd4c67b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:00.973586 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-16df1865-426b-43df-8440-faa77cd4c67b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:00.975544 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-16df1865-426b-43df-8440-faa77cd4c67b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:00.976006 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-16df1865-426b-43df-8440-faa77cd4c67b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:00.976494 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-16df1865-426b-43df-8440-faa77cd4c67b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:01.051200 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-16df1865-426b-43df-8440-faa77cd4c67b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:01.060899 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-16df1865-426b-43df-8440-faa77cd4c67b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2" status: 200 len: 1200 microversion: 2.1 time: 0.102027 Aug 24 04:05:01.061484 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 535/1064] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:00 2022] GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2 => generated 1200 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:02.081781 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-041892c4-aed1-4822-848d-4da85b914830 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:02.082403 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-041892c4-aed1-4822-848d-4da85b914830 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 3ae1189b-ce08-4b70-9eaa-e7c9efb191a2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:02.090601 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-041892c4-aed1-4822-848d-4da85b914830 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:02.091130 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-041892c4-aed1-4822-848d-4da85b914830 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:02.091570 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-041892c4-aed1-4822-848d-4da85b914830 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:02.092294 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-041892c4-aed1-4822-848d-4da85b914830 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:02.092752 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-041892c4-aed1-4822-848d-4da85b914830 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:02.093179 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-041892c4-aed1-4822-848d-4da85b914830 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:02.244579 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-041892c4-aed1-4822-848d-4da85b914830 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:02.252925 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-041892c4-aed1-4822-848d-4da85b914830 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2" status: 200 len: 1278 microversion: 2.1 time: 0.175351 Aug 24 04:05:02.253751 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 530/1065] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:02 2022] GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2 => generated 1278 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:02.888700 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-e0a68350-aff5-4105-9be3-402ac17f3453 req-76a6c08f-6db4-4e8d-9413-6caa3040097d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ae1189b-ce08-4b70-9eaa-e7c9efb191a2", "tag": "ade9c2d9-0ec3-430c-84bc-adbe62716f2c"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:05:02.900603 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-e0a68350-aff5-4105-9be3-402ac17f3453 req-76a6c08f-6db4-4e8d-9413-6caa3040097d service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:02.901197 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-e0a68350-aff5-4105-9be3-402ac17f3453 req-76a6c08f-6db4-4e8d-9413-6caa3040097d service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:02.901700 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-e0a68350-aff5-4105-9be3-402ac17f3453 req-76a6c08f-6db4-4e8d-9413-6caa3040097d service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:02.913749 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-e0a68350-aff5-4105-9be3-402ac17f3453 req-76a6c08f-6db4-4e8d-9413-6caa3040097d service nova] Creating event network-changed:ade9c2d9-0ec3-430c-84bc-adbe62716f2c for instance 3ae1189b-ce08-4b70-9eaa-e7c9efb191a2 on hv-cinder-85426 Aug 24 04:05:02.918886 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-e0a68350-aff5-4105-9be3-402ac17f3453 req-76a6c08f-6db4-4e8d-9413-6caa3040097d service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033885 Aug 24 04:05:02.919466 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 536/1066] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 04:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:05:03.276208 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-216857f1-5135-4d15-8f25-81d815611385 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:03.276820 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-216857f1-5135-4d15-8f25-81d815611385 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 3ae1189b-ce08-4b70-9eaa-e7c9efb191a2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:03.283828 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-216857f1-5135-4d15-8f25-81d815611385 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:03.284321 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-216857f1-5135-4d15-8f25-81d815611385 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:03.284735 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-216857f1-5135-4d15-8f25-81d815611385 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:03.285428 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-216857f1-5135-4d15-8f25-81d815611385 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:03.285875 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-216857f1-5135-4d15-8f25-81d815611385 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:03.286300 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-216857f1-5135-4d15-8f25-81d815611385 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:03.431644 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-216857f1-5135-4d15-8f25-81d815611385 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:03.439557 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-216857f1-5135-4d15-8f25-81d815611385 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2" status: 200 len: 1266 microversion: 2.1 time: 0.168675 Aug 24 04:05:03.440306 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 531/1067] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:03 2022] GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:04.462828 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-deb2c6d5-d10b-4881-b3d3-32b53a735095 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:04.463528 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-deb2c6d5-d10b-4881-b3d3-32b53a735095 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 3ae1189b-ce08-4b70-9eaa-e7c9efb191a2] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:04.469599 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-deb2c6d5-d10b-4881-b3d3-32b53a735095 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:04.470075 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-deb2c6d5-d10b-4881-b3d3-32b53a735095 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:04.470542 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-deb2c6d5-d10b-4881-b3d3-32b53a735095 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:04.471251 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-deb2c6d5-d10b-4881-b3d3-32b53a735095 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:04.471703 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-deb2c6d5-d10b-4881-b3d3-32b53a735095 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:04.472130 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-deb2c6d5-d10b-4881-b3d3-32b53a735095 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:04.607891 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-deb2c6d5-d10b-4881-b3d3-32b53a735095 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:04.615949 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-deb2c6d5-d10b-4881-b3d3-32b53a735095 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2" status: 200 len: 1266 microversion: 2.1 time: 0.158528 Aug 24 04:05:04.616515 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 537/1068] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:04 2022] GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:05.636826 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0eab1403-ac4f-4f8a-b5c7-d792c3928380 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:05.637437 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-0eab1403-ac4f-4f8a-b5c7-d792c3928380 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 3ae1189b-ce08-4b70-9eaa-e7c9efb191a2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:05.643894 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0eab1403-ac4f-4f8a-b5c7-d792c3928380 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:05.644369 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0eab1403-ac4f-4f8a-b5c7-d792c3928380 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:05.644801 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0eab1403-ac4f-4f8a-b5c7-d792c3928380 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:05.645487 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0eab1403-ac4f-4f8a-b5c7-d792c3928380 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:05.646722 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0eab1403-ac4f-4f8a-b5c7-d792c3928380 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:05.647149 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-0eab1403-ac4f-4f8a-b5c7-d792c3928380 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:05.784939 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-0eab1403-ac4f-4f8a-b5c7-d792c3928380 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:05.792811 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0eab1403-ac4f-4f8a-b5c7-d792c3928380 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2" status: 200 len: 1266 microversion: 2.1 time: 0.159956 Aug 24 04:05:05.793387 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 532/1069] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:05 2022] GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:06.812896 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-2f9a4568-e1ed-4e50-b390-884e92c8345b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:06.813493 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-2f9a4568-e1ed-4e50-b390-884e92c8345b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 3ae1189b-ce08-4b70-9eaa-e7c9efb191a2] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:06.820623 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2f9a4568-e1ed-4e50-b390-884e92c8345b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:06.821092 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2f9a4568-e1ed-4e50-b390-884e92c8345b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:06.821520 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2f9a4568-e1ed-4e50-b390-884e92c8345b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:06.822195 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2f9a4568-e1ed-4e50-b390-884e92c8345b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:06.822669 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2f9a4568-e1ed-4e50-b390-884e92c8345b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:06.823083 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-2f9a4568-e1ed-4e50-b390-884e92c8345b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:06.956556 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-2f9a4568-e1ed-4e50-b390-884e92c8345b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:06.964317 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-2f9a4568-e1ed-4e50-b390-884e92c8345b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2" status: 200 len: 1266 microversion: 2.1 time: 0.155245 Aug 24 04:05:06.964897 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 538/1070] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:06 2022] GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:07.985490 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-72f02188-63fa-462e-8075-59c68401dbba tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:07.986032 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-72f02188-63fa-462e-8075-59c68401dbba tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 3ae1189b-ce08-4b70-9eaa-e7c9efb191a2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:07.993249 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-72f02188-63fa-462e-8075-59c68401dbba tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:07.993768 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-72f02188-63fa-462e-8075-59c68401dbba tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:07.994203 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-72f02188-63fa-462e-8075-59c68401dbba tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:07.994925 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-72f02188-63fa-462e-8075-59c68401dbba tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:07.995380 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-72f02188-63fa-462e-8075-59c68401dbba tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:07.995801 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-72f02188-63fa-462e-8075-59c68401dbba tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:08.131512 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-72f02188-63fa-462e-8075-59c68401dbba tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:08.139296 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-72f02188-63fa-462e-8075-59c68401dbba tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2" status: 200 len: 1266 microversion: 2.1 time: 0.157903 Aug 24 04:05:08.139862 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 533/1071] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:07 2022] GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:09.160823 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-1a852803-eada-4c27-8237-e322639c6930 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:09.161561 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-1a852803-eada-4c27-8237-e322639c6930 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 3ae1189b-ce08-4b70-9eaa-e7c9efb191a2] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:09.164010 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell0:SELECT=2 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:05:09.168982 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1a852803-eada-4c27-8237-e322639c6930 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:09.169524 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1a852803-eada-4c27-8237-e322639c6930 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:09.170074 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1a852803-eada-4c27-8237-e322639c6930 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:09.170876 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1a852803-eada-4c27-8237-e322639c6930 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:09.171429 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1a852803-eada-4c27-8237-e322639c6930 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:09.171897 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-1a852803-eada-4c27-8237-e322639c6930 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:09.308273 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-1a852803-eada-4c27-8237-e322639c6930 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:09.316111 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-1a852803-eada-4c27-8237-e322639c6930 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2" status: 200 len: 1266 microversion: 2.1 time: 0.159156 Aug 24 04:05:09.316610 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 539/1072] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:09 2022] GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:10.337423 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-85a4b8a7-15d4-44d0-a86e-b26a8ada7309 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:10.337978 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-85a4b8a7-15d4-44d0-a86e-b26a8ada7309 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 3ae1189b-ce08-4b70-9eaa-e7c9efb191a2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:10.339840 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:05:10.340497 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:05:10.345704 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85a4b8a7-15d4-44d0-a86e-b26a8ada7309 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:10.346192 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85a4b8a7-15d4-44d0-a86e-b26a8ada7309 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:10.346662 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85a4b8a7-15d4-44d0-a86e-b26a8ada7309 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:10.348237 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85a4b8a7-15d4-44d0-a86e-b26a8ada7309 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:10.348237 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85a4b8a7-15d4-44d0-a86e-b26a8ada7309 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:10.348237 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-85a4b8a7-15d4-44d0-a86e-b26a8ada7309 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:10.484839 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-85a4b8a7-15d4-44d0-a86e-b26a8ada7309 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:10.493106 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-85a4b8a7-15d4-44d0-a86e-b26a8ada7309 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2" status: 200 len: 1266 microversion: 2.1 time: 0.160406 Aug 24 04:05:10.493678 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 534/1073] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:10 2022] GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:11.514717 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-aa8c0c5e-6506-4517-89eb-5c39b17be169 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:11.515299 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-aa8c0c5e-6506-4517-89eb-5c39b17be169 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 3ae1189b-ce08-4b70-9eaa-e7c9efb191a2] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:11.522325 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-aa8c0c5e-6506-4517-89eb-5c39b17be169 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:11.522821 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-aa8c0c5e-6506-4517-89eb-5c39b17be169 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:11.523248 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-aa8c0c5e-6506-4517-89eb-5c39b17be169 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:11.523924 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-aa8c0c5e-6506-4517-89eb-5c39b17be169 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:11.524474 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-aa8c0c5e-6506-4517-89eb-5c39b17be169 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:11.524809 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-aa8c0c5e-6506-4517-89eb-5c39b17be169 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:11.658271 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-aa8c0c5e-6506-4517-89eb-5c39b17be169 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:11.665860 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-aa8c0c5e-6506-4517-89eb-5c39b17be169 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2" status: 200 len: 1266 microversion: 2.1 time: 0.155057 Aug 24 04:05:11.666632 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 540/1074] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:11 2022] GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:12.686720 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-253aed81-bea2-4e67-9d99-8f483c18e699 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:12.687335 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-253aed81-bea2-4e67-9d99-8f483c18e699 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 3ae1189b-ce08-4b70-9eaa-e7c9efb191a2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:12.693856 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-253aed81-bea2-4e67-9d99-8f483c18e699 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:12.694330 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-253aed81-bea2-4e67-9d99-8f483c18e699 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:12.694804 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-253aed81-bea2-4e67-9d99-8f483c18e699 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:12.695490 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-253aed81-bea2-4e67-9d99-8f483c18e699 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:12.695941 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-253aed81-bea2-4e67-9d99-8f483c18e699 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:12.696352 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-253aed81-bea2-4e67-9d99-8f483c18e699 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:12.825576 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-253aed81-bea2-4e67-9d99-8f483c18e699 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:12.834374 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-253aed81-bea2-4e67-9d99-8f483c18e699 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2" status: 200 len: 1266 microversion: 2.1 time: 0.151141 Aug 24 04:05:12.834987 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 535/1075] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:12 2022] GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:13.855755 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-72bf7d1d-568c-447d-bd5a-17073905806a tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:13.856318 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-72bf7d1d-568c-447d-bd5a-17073905806a tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 3ae1189b-ce08-4b70-9eaa-e7c9efb191a2] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:13.862689 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-72bf7d1d-568c-447d-bd5a-17073905806a tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:13.863163 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-72bf7d1d-568c-447d-bd5a-17073905806a tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:13.863592 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-72bf7d1d-568c-447d-bd5a-17073905806a tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:13.864956 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-72bf7d1d-568c-447d-bd5a-17073905806a tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:13.865405 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-72bf7d1d-568c-447d-bd5a-17073905806a tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:13.865819 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-72bf7d1d-568c-447d-bd5a-17073905806a tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:14.001323 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-72bf7d1d-568c-447d-bd5a-17073905806a tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:14.009851 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-72bf7d1d-568c-447d-bd5a-17073905806a tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2" status: 200 len: 1266 microversion: 2.1 time: 0.157934 Aug 24 04:05:14.010487 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 541/1076] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:13 2022] GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:15.030862 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c540f11c-c2a0-4d8e-98b6-dca0749ddfdd tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:15.031471 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c540f11c-c2a0-4d8e-98b6-dca0749ddfdd tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 3ae1189b-ce08-4b70-9eaa-e7c9efb191a2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:15.037896 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c540f11c-c2a0-4d8e-98b6-dca0749ddfdd tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:15.038368 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c540f11c-c2a0-4d8e-98b6-dca0749ddfdd tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:15.038845 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c540f11c-c2a0-4d8e-98b6-dca0749ddfdd tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:15.044471 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c540f11c-c2a0-4d8e-98b6-dca0749ddfdd tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:15.044471 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c540f11c-c2a0-4d8e-98b6-dca0749ddfdd tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:15.044471 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c540f11c-c2a0-4d8e-98b6-dca0749ddfdd tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:15.182124 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-c540f11c-c2a0-4d8e-98b6-dca0749ddfdd tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:15.183584 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-6111fa5f-e0b4-4ed3-a3a2-1eab779c59b2 req-13c2e321-7701-41ac-bef3-5eb8658f0ddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ae1189b-ce08-4b70-9eaa-e7c9efb191a2", "name": "network-vif-plugged", "status": "completed", "tag": "ade9c2d9-0ec3-430c-84bc-adbe62716f2c"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:05:15.186528 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c540f11c-c2a0-4d8e-98b6-dca0749ddfdd tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2" status: 200 len: 1266 microversion: 2.1 time: 0.159587 Aug 24 04:05:15.187367 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 536/1077] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:15 2022] GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:15.194426 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-6111fa5f-e0b4-4ed3-a3a2-1eab779c59b2 req-13c2e321-7701-41ac-bef3-5eb8658f0ddd service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:15.194931 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-6111fa5f-e0b4-4ed3-a3a2-1eab779c59b2 req-13c2e321-7701-41ac-bef3-5eb8658f0ddd service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:15.195401 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-6111fa5f-e0b4-4ed3-a3a2-1eab779c59b2 req-13c2e321-7701-41ac-bef3-5eb8658f0ddd service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:15.206309 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-6111fa5f-e0b4-4ed3-a3a2-1eab779c59b2 req-13c2e321-7701-41ac-bef3-5eb8658f0ddd service nova] Creating event network-vif-plugged:ade9c2d9-0ec3-430c-84bc-adbe62716f2c for instance 3ae1189b-ce08-4b70-9eaa-e7c9efb191a2 on hv-cinder-85426 Aug 24 04:05:15.211525 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-6111fa5f-e0b4-4ed3-a3a2-1eab779c59b2 req-13c2e321-7701-41ac-bef3-5eb8658f0ddd service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031965 Aug 24 04:05:15.212260 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 542/1078] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 04:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:05:15.497777 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4f4dc912-fc99-4ad2-85c5-4f58f1dd095b tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:05:15.498228 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4f4dc912-fc99-4ad2-85c5-4f58f1dd095b tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:15.504639 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f4dc912-fc99-4ad2-85c5-4f58f1dd095b tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:15.505116 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f4dc912-fc99-4ad2-85c5-4f58f1dd095b tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:15.505552 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f4dc912-fc99-4ad2-85c5-4f58f1dd095b tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:15.506237 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f4dc912-fc99-4ad2-85c5-4f58f1dd095b tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:15.506726 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f4dc912-fc99-4ad2-85c5-4f58f1dd095b tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:15.507147 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f4dc912-fc99-4ad2-85c5-4f58f1dd095b tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:15.529825 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.objects.instance [None req-4f4dc912-fc99-4ad2-85c5-4f58f1dd095b tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lazy-loading 'flavor' on Instance uuid a594d5f2-3dd6-44f5-88bb-56396538864b {{(pid=127870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:05:15.889510 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4f4dc912-fc99-4ad2-85c5-4f58f1dd095b tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "POST /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b/action" status: 202 len: 0 microversion: 2.1 time: 0.395456 Aug 24 04:05:15.890026 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 537/1079] 10.222.0.82 () {60 vars in 1278 bytes} [Wed Aug 24 04:05:15 2022] POST /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b/action => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 04:05:15.900199 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-9444b000-f050-4093-8bb3-5f86a8cc0414 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:15.900901 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-9444b000-f050-4093-8bb3-5f86a8cc0414 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:15.907206 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9444b000-f050-4093-8bb3-5f86a8cc0414 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:15.907762 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9444b000-f050-4093-8bb3-5f86a8cc0414 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:15.908113 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9444b000-f050-4093-8bb3-5f86a8cc0414 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:15.908852 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9444b000-f050-4093-8bb3-5f86a8cc0414 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:15.909240 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9444b000-f050-4093-8bb3-5f86a8cc0414 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:15.909658 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-9444b000-f050-4093-8bb3-5f86a8cc0414 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:16.059331 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-9444b000-f050-4093-8bb3-5f86a8cc0414 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:16.068872 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-9444b000-f050-4093-8bb3-5f86a8cc0414 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1567 microversion: 2.1 time: 0.174190 Aug 24 04:05:16.069443 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 543/1080] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:15 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:16.209799 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-424521c9-faa4-425d-9888-89968ef9600c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:16.210545 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-424521c9-faa4-425d-9888-89968ef9600c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 3ae1189b-ce08-4b70-9eaa-e7c9efb191a2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:16.218205 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-424521c9-faa4-425d-9888-89968ef9600c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:16.218774 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-424521c9-faa4-425d-9888-89968ef9600c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:16.219206 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-424521c9-faa4-425d-9888-89968ef9600c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:16.219899 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-424521c9-faa4-425d-9888-89968ef9600c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:16.220357 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-424521c9-faa4-425d-9888-89968ef9600c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:16.220766 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-424521c9-faa4-425d-9888-89968ef9600c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:16.385861 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-424521c9-faa4-425d-9888-89968ef9600c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:16.393597 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-424521c9-faa4-425d-9888-89968ef9600c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2" status: 200 len: 1266 microversion: 2.1 time: 0.189235 Aug 24 04:05:16.394167 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 538/1081] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:16 2022] GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2 => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:17.091509 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-ba23d2a3-2ce4-4139-964e-636b702e9a7d tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:17.092142 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-ba23d2a3-2ce4-4139-964e-636b702e9a7d tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:17.098653 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ba23d2a3-2ce4-4139-964e-636b702e9a7d tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:17.099878 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ba23d2a3-2ce4-4139-964e-636b702e9a7d tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:17.100333 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ba23d2a3-2ce4-4139-964e-636b702e9a7d tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:17.101048 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ba23d2a3-2ce4-4139-964e-636b702e9a7d tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:17.101504 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ba23d2a3-2ce4-4139-964e-636b702e9a7d tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:17.101932 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ba23d2a3-2ce4-4139-964e-636b702e9a7d tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:17.321921 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-ba23d2a3-2ce4-4139-964e-636b702e9a7d tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:17.329803 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-ba23d2a3-2ce4-4139-964e-636b702e9a7d tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1567 microversion: 2.1 time: 0.242132 Aug 24 04:05:17.330475 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 544/1082] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:17 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1567 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:17.413650 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-713e427b-de92-4212-874b-a8cce09152de tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:17.414344 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-713e427b-de92-4212-874b-a8cce09152de tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 3ae1189b-ce08-4b70-9eaa-e7c9efb191a2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:17.420816 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-713e427b-de92-4212-874b-a8cce09152de tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:17.421297 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-713e427b-de92-4212-874b-a8cce09152de tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:17.421729 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-713e427b-de92-4212-874b-a8cce09152de tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:17.422422 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-713e427b-de92-4212-874b-a8cce09152de tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:17.422902 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-713e427b-de92-4212-874b-a8cce09152de tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:17.423382 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-713e427b-de92-4212-874b-a8cce09152de tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:17.562420 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-713e427b-de92-4212-874b-a8cce09152de tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:17.566058 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:05:17.570783 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-713e427b-de92-4212-874b-a8cce09152de tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2" status: 200 len: 1454 microversion: 2.1 time: 0.161366 Aug 24 04:05:17.571364 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 539/1083] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:17 2022] GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2 => generated 1454 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:17.590898 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-408d1e2e-7fea-4706-a2a9-79c7c147c0f6 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:17.591581 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-408d1e2e-7fea-4706-a2a9-79c7c147c0f6 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 3ae1189b-ce08-4b70-9eaa-e7c9efb191a2] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:17.597400 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-408d1e2e-7fea-4706-a2a9-79c7c147c0f6 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:17.597877 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-408d1e2e-7fea-4706-a2a9-79c7c147c0f6 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:17.598838 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-408d1e2e-7fea-4706-a2a9-79c7c147c0f6 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:17.599635 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-408d1e2e-7fea-4706-a2a9-79c7c147c0f6 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:17.600090 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-408d1e2e-7fea-4706-a2a9-79c7c147c0f6 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:17.600508 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-408d1e2e-7fea-4706-a2a9-79c7c147c0f6 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:17.776563 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-408d1e2e-7fea-4706-a2a9-79c7c147c0f6 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:17.784520 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-408d1e2e-7fea-4706-a2a9-79c7c147c0f6 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2" status: 200 len: 1454 microversion: 2.1 time: 0.197424 Aug 24 04:05:17.785116 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 545/1084] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:17 2022] GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2 => generated 1454 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:05:18.352230 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1bde9cd8-5be4-4458-9534-c1cd7b06bc88 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:18.352849 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1bde9cd8-5be4-4458-9534-c1cd7b06bc88 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:18.359839 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1bde9cd8-5be4-4458-9534-c1cd7b06bc88 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:18.360268 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1bde9cd8-5be4-4458-9534-c1cd7b06bc88 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:18.360712 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1bde9cd8-5be4-4458-9534-c1cd7b06bc88 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:18.361520 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1bde9cd8-5be4-4458-9534-c1cd7b06bc88 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:18.361980 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1bde9cd8-5be4-4458-9534-c1cd7b06bc88 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:18.362406 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1bde9cd8-5be4-4458-9534-c1cd7b06bc88 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:18.510293 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-1bde9cd8-5be4-4458-9534-c1cd7b06bc88 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:18.518354 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1bde9cd8-5be4-4458-9534-c1cd7b06bc88 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1567 microversion: 2.1 time: 0.170581 Aug 24 04:05:18.519221 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 540/1085] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:18 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:19.541622 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-ac938070-503e-435b-b8ea-eeff0dfc2fa3 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:19.542329 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-ac938070-503e-435b-b8ea-eeff0dfc2fa3 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:19.548845 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ac938070-503e-435b-b8ea-eeff0dfc2fa3 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:19.550424 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ac938070-503e-435b-b8ea-eeff0dfc2fa3 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:19.550944 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ac938070-503e-435b-b8ea-eeff0dfc2fa3 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:19.552490 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ac938070-503e-435b-b8ea-eeff0dfc2fa3 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:19.552707 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ac938070-503e-435b-b8ea-eeff0dfc2fa3 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:19.553146 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ac938070-503e-435b-b8ea-eeff0dfc2fa3 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:19.772289 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-ac938070-503e-435b-b8ea-eeff0dfc2fa3 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:19.780015 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-ac938070-503e-435b-b8ea-eeff0dfc2fa3 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1567 microversion: 2.1 time: 0.242281 Aug 24 04:05:19.788983 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 546/1086] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:19 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1567 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:20.318774 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-00705507-e49d-42e4-a474-8f9301a107a3 req-ac9b37c7-6291-4eb9-88e0-b9767c070f97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ae1189b-ce08-4b70-9eaa-e7c9efb191a2", "tag": "ade9c2d9-0ec3-430c-84bc-adbe62716f2c"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:05:20.329520 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-00705507-e49d-42e4-a474-8f9301a107a3 req-ac9b37c7-6291-4eb9-88e0-b9767c070f97 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:20.330098 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-00705507-e49d-42e4-a474-8f9301a107a3 req-ac9b37c7-6291-4eb9-88e0-b9767c070f97 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:20.330641 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-00705507-e49d-42e4-a474-8f9301a107a3 req-ac9b37c7-6291-4eb9-88e0-b9767c070f97 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:20.343327 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-00705507-e49d-42e4-a474-8f9301a107a3 req-ac9b37c7-6291-4eb9-88e0-b9767c070f97 service nova] Creating event network-changed:ade9c2d9-0ec3-430c-84bc-adbe62716f2c for instance 3ae1189b-ce08-4b70-9eaa-e7c9efb191a2 on hv-cinder-85426 Aug 24 04:05:20.349170 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-00705507-e49d-42e4-a474-8f9301a107a3 req-ac9b37c7-6291-4eb9-88e0-b9767c070f97 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034421 Aug 24 04:05:20.349832 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 541/1087] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 04:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:05:20.802804 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-c45fad2c-846e-4cdf-af29-503d0ae5f048 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:20.804229 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-c45fad2c-846e-4cdf-af29-503d0ae5f048 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:20.811043 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c45fad2c-846e-4cdf-af29-503d0ae5f048 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:20.811531 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c45fad2c-846e-4cdf-af29-503d0ae5f048 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:20.813695 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c45fad2c-846e-4cdf-af29-503d0ae5f048 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:20.813695 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c45fad2c-846e-4cdf-af29-503d0ae5f048 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:20.813695 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c45fad2c-846e-4cdf-af29-503d0ae5f048 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:20.813695 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c45fad2c-846e-4cdf-af29-503d0ae5f048 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:21.010105 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-c45fad2c-846e-4cdf-af29-503d0ae5f048 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:21.017863 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-c45fad2c-846e-4cdf-af29-503d0ae5f048 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1567 microversion: 2.1 time: 0.220511 Aug 24 04:05:21.018424 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 547/1088] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:20 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1567 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:22.041443 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-1dad0ca1-017f-4f38-8e52-a0c53fc18900 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:22.042450 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-1dad0ca1-017f-4f38-8e52-a0c53fc18900 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:22.048521 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1dad0ca1-017f-4f38-8e52-a0c53fc18900 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:22.049107 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1dad0ca1-017f-4f38-8e52-a0c53fc18900 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:22.049548 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1dad0ca1-017f-4f38-8e52-a0c53fc18900 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:22.050333 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1dad0ca1-017f-4f38-8e52-a0c53fc18900 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:22.050821 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1dad0ca1-017f-4f38-8e52-a0c53fc18900 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:22.051248 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-1dad0ca1-017f-4f38-8e52-a0c53fc18900 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:22.184656 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-1dad0ca1-017f-4f38-8e52-a0c53fc18900 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:22.192523 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-1dad0ca1-017f-4f38-8e52-a0c53fc18900 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1567 microversion: 2.1 time: 0.156588 Aug 24 04:05:22.193141 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 542/1089] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:22 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:23.214455 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-bf29ec83-de1a-44ca-98f5-252266ed5594 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:23.215086 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-bf29ec83-de1a-44ca-98f5-252266ed5594 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:23.217054 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:05:23.221624 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bf29ec83-de1a-44ca-98f5-252266ed5594 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:23.222098 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bf29ec83-de1a-44ca-98f5-252266ed5594 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:23.222549 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bf29ec83-de1a-44ca-98f5-252266ed5594 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:23.224850 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bf29ec83-de1a-44ca-98f5-252266ed5594 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:23.224850 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bf29ec83-de1a-44ca-98f5-252266ed5594 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:23.224850 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bf29ec83-de1a-44ca-98f5-252266ed5594 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:23.227317 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:05:23.376351 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-bf29ec83-de1a-44ca-98f5-252266ed5594 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:23.385673 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-bf29ec83-de1a-44ca-98f5-252266ed5594 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1567 microversion: 2.1 time: 0.175265 Aug 24 04:05:23.386236 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 548/1090] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:23 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:24.407499 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f5b55cef-0ba4-46dc-9458-31acf7d0a657 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:24.408108 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f5b55cef-0ba4-46dc-9458-31acf7d0a657 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:24.410528 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:05:24.415475 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f5b55cef-0ba4-46dc-9458-31acf7d0a657 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:24.415956 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f5b55cef-0ba4-46dc-9458-31acf7d0a657 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:24.416393 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f5b55cef-0ba4-46dc-9458-31acf7d0a657 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:24.417081 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f5b55cef-0ba4-46dc-9458-31acf7d0a657 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:24.417531 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f5b55cef-0ba4-46dc-9458-31acf7d0a657 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:24.417954 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f5b55cef-0ba4-46dc-9458-31acf7d0a657 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:24.550456 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-f5b55cef-0ba4-46dc-9458-31acf7d0a657 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:24.558370 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f5b55cef-0ba4-46dc-9458-31acf7d0a657 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1567 microversion: 2.1 time: 0.154705 Aug 24 04:05:24.558956 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 543/1091] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:24 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:25.580424 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-d425a02b-a12d-4fd5-b84a-5bd123d741b8 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:25.581022 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-d425a02b-a12d-4fd5-b84a-5bd123d741b8 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:25.587610 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d425a02b-a12d-4fd5-b84a-5bd123d741b8 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:25.588085 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d425a02b-a12d-4fd5-b84a-5bd123d741b8 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:25.588508 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d425a02b-a12d-4fd5-b84a-5bd123d741b8 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:25.589190 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d425a02b-a12d-4fd5-b84a-5bd123d741b8 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:25.589628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d425a02b-a12d-4fd5-b84a-5bd123d741b8 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:25.590038 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d425a02b-a12d-4fd5-b84a-5bd123d741b8 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:25.728070 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-d425a02b-a12d-4fd5-b84a-5bd123d741b8 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:25.736040 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-d425a02b-a12d-4fd5-b84a-5bd123d741b8 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1567 microversion: 2.1 time: 0.159890 Aug 24 04:05:25.736691 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 549/1092] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:25 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:26.758001 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f50711ed-ef4b-43b2-a124-70fe6585a22c tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:26.758652 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f50711ed-ef4b-43b2-a124-70fe6585a22c tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:26.765252 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f50711ed-ef4b-43b2-a124-70fe6585a22c tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:26.765733 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f50711ed-ef4b-43b2-a124-70fe6585a22c tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:26.766168 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f50711ed-ef4b-43b2-a124-70fe6585a22c tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:26.766937 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f50711ed-ef4b-43b2-a124-70fe6585a22c tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:26.767335 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f50711ed-ef4b-43b2-a124-70fe6585a22c tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:26.767755 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f50711ed-ef4b-43b2-a124-70fe6585a22c tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:26.904193 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-f50711ed-ef4b-43b2-a124-70fe6585a22c tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:26.912564 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f50711ed-ef4b-43b2-a124-70fe6585a22c tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1567 microversion: 2.1 time: 0.158847 Aug 24 04:05:26.913242 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 544/1093] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:26 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:27.933667 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-eaaec551-a7ca-4278-a0a9-a188b76ed209 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:27.934273 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-eaaec551-a7ca-4278-a0a9-a188b76ed209 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:27.940888 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-eaaec551-a7ca-4278-a0a9-a188b76ed209 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:27.941371 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-eaaec551-a7ca-4278-a0a9-a188b76ed209 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:27.942574 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-eaaec551-a7ca-4278-a0a9-a188b76ed209 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:27.943173 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-eaaec551-a7ca-4278-a0a9-a188b76ed209 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:27.943624 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-eaaec551-a7ca-4278-a0a9-a188b76ed209 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:27.944068 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-eaaec551-a7ca-4278-a0a9-a188b76ed209 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:28.092956 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-eaaec551-a7ca-4278-a0a9-a188b76ed209 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:28.101033 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-eaaec551-a7ca-4278-a0a9-a188b76ed209 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1567 microversion: 2.1 time: 0.171164 Aug 24 04:05:28.103188 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 550/1094] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:27 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:29.122151 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4c116780-e6a0-494d-811b-015bf0f6514d tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:29.122791 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4c116780-e6a0-494d-811b-015bf0f6514d tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:29.128630 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4c116780-e6a0-494d-811b-015bf0f6514d tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:29.129847 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4c116780-e6a0-494d-811b-015bf0f6514d tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:29.130017 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4c116780-e6a0-494d-811b-015bf0f6514d tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:29.130780 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4c116780-e6a0-494d-811b-015bf0f6514d tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:29.131234 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4c116780-e6a0-494d-811b-015bf0f6514d tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:29.131661 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4c116780-e6a0-494d-811b-015bf0f6514d tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:29.264604 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-4c116780-e6a0-494d-811b-015bf0f6514d tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:29.274075 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4c116780-e6a0-494d-811b-015bf0f6514d tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1567 microversion: 2.1 time: 0.154696 Aug 24 04:05:29.274075 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 545/1095] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:29 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:05:30.296812 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-84acbc55-4670-454d-933e-44d70a3a409e tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:30.297453 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-84acbc55-4670-454d-933e-44d70a3a409e tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:30.306213 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-84acbc55-4670-454d-933e-44d70a3a409e tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:30.306733 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-84acbc55-4670-454d-933e-44d70a3a409e tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:30.307222 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-84acbc55-4670-454d-933e-44d70a3a409e tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:30.307924 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-84acbc55-4670-454d-933e-44d70a3a409e tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:30.308378 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-84acbc55-4670-454d-933e-44d70a3a409e tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:30.308802 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-84acbc55-4670-454d-933e-44d70a3a409e tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:30.444794 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-84acbc55-4670-454d-933e-44d70a3a409e tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:30.453024 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-84acbc55-4670-454d-933e-44d70a3a409e tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1568 microversion: 2.1 time: 0.161571 Aug 24 04:05:30.453677 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 551/1096] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:30 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:30.474528 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-62e1e3f1-1632-4769-a531-3eaf77f2f9c5 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:05:30.475124 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-62e1e3f1-1632-4769-a531-3eaf77f2f9c5 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:30.481462 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62e1e3f1-1632-4769-a531-3eaf77f2f9c5 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:30.483453 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62e1e3f1-1632-4769-a531-3eaf77f2f9c5 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:30.483453 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62e1e3f1-1632-4769-a531-3eaf77f2f9c5 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:30.483453 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62e1e3f1-1632-4769-a531-3eaf77f2f9c5 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:30.483763 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62e1e3f1-1632-4769-a531-3eaf77f2f9c5 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:30.484022 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62e1e3f1-1632-4769-a531-3eaf77f2f9c5 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:30.524552 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-62e1e3f1-1632-4769-a531-3eaf77f2f9c5 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127870) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 04:05:30.828233 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-62e1e3f1-1632-4769-a531-3eaf77f2f9c5 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "POST /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b/action" status: 202 len: 0 microversion: 2.1 time: 0.358297 Aug 24 04:05:30.828881 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 546/1097] 10.222.0.82 () {60 vars in 1278 bytes} [Wed Aug 24 04:05:30 2022] POST /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:05:30.837309 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-4ad46fc0-4c36-4b31-a94e-7eaa4ad405ab tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:30.837924 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-4ad46fc0-4c36-4b31-a94e-7eaa4ad405ab tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:30.843997 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4ad46fc0-4c36-4b31-a94e-7eaa4ad405ab tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:30.844479 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4ad46fc0-4c36-4b31-a94e-7eaa4ad405ab tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:30.844917 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4ad46fc0-4c36-4b31-a94e-7eaa4ad405ab tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:30.845604 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4ad46fc0-4c36-4b31-a94e-7eaa4ad405ab tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:30.846056 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4ad46fc0-4c36-4b31-a94e-7eaa4ad405ab tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:30.846637 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-4ad46fc0-4c36-4b31-a94e-7eaa4ad405ab tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:30.985638 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-4ad46fc0-4c36-4b31-a94e-7eaa4ad405ab tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:30.992208 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-4ad46fc0-4c36-4b31-a94e-7eaa4ad405ab tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1516 microversion: 2.1 time: 0.158743 Aug 24 04:05:30.992775 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 552/1098] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:30 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:32.014564 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bf6a3416-f134-4cf1-afd6-dd35958658cc tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:32.015141 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bf6a3416-f134-4cf1-afd6-dd35958658cc tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:32.023242 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf6a3416-f134-4cf1-afd6-dd35958658cc tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:32.023767 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf6a3416-f134-4cf1-afd6-dd35958658cc tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:32.024296 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf6a3416-f134-4cf1-afd6-dd35958658cc tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:32.025257 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf6a3416-f134-4cf1-afd6-dd35958658cc tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:32.025826 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf6a3416-f134-4cf1-afd6-dd35958658cc tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:32.026624 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bf6a3416-f134-4cf1-afd6-dd35958658cc tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:32.208013 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-bf6a3416-f134-4cf1-afd6-dd35958658cc tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:32.215806 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bf6a3416-f134-4cf1-afd6-dd35958658cc tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1516 microversion: 2.1 time: 0.205739 Aug 24 04:05:32.218888 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 547/1099] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:32 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1516 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:33.125483 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-4afac071-a554-44bf-9112-1cc995697821 req-6c9a629f-2cf3-47e4-be24-709c342a6a5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a594d5f2-3dd6-44f5-88bb-56396538864b", "name": "network-vif-unplugged", "status": "completed", "tag": "3f135d8e-5df6-49a2-8a9b-f5b220e13806"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:05:33.136462 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-4afac071-a554-44bf-9112-1cc995697821 req-6c9a629f-2cf3-47e4-be24-709c342a6a5c service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:33.141450 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-4afac071-a554-44bf-9112-1cc995697821 req-6c9a629f-2cf3-47e4-be24-709c342a6a5c service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:33.141450 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-4afac071-a554-44bf-9112-1cc995697821 req-6c9a629f-2cf3-47e4-be24-709c342a6a5c service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:33.148949 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.compute.server_external_events [req-4afac071-a554-44bf-9112-1cc995697821 req-6c9a629f-2cf3-47e4-be24-709c342a6a5c service nova] Unable to find a host for instance a594d5f2-3dd6-44f5-88bb-56396538864b. Dropping event network-vif-unplugged {{(pid=127869) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 04:05:33.149813 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-4afac071-a554-44bf-9112-1cc995697821 req-6c9a629f-2cf3-47e4-be24-709c342a6a5c service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028231 Aug 24 04:05:33.150389 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 553/1100] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 04:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 24 04:05:33.237173 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7f12d53a-e206-452c-a7e5-31148b847aba tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:33.237782 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7f12d53a-e206-452c-a7e5-31148b847aba tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:33.244215 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7f12d53a-e206-452c-a7e5-31148b847aba tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:33.244689 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7f12d53a-e206-452c-a7e5-31148b847aba tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:33.245116 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7f12d53a-e206-452c-a7e5-31148b847aba tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:33.245798 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7f12d53a-e206-452c-a7e5-31148b847aba tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:33.246243 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7f12d53a-e206-452c-a7e5-31148b847aba tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:33.246693 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7f12d53a-e206-452c-a7e5-31148b847aba tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:33.387180 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-7f12d53a-e206-452c-a7e5-31148b847aba tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:33.395110 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7f12d53a-e206-452c-a7e5-31148b847aba tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1516 microversion: 2.1 time: 0.161747 Aug 24 04:05:33.395789 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 548/1101] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:33 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:34.416729 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-7ac4c934-ba2d-4d76-a74f-1e72518ce95b tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:34.417357 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-7ac4c934-ba2d-4d76-a74f-1e72518ce95b tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:34.423710 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7ac4c934-ba2d-4d76-a74f-1e72518ce95b tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:34.424182 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7ac4c934-ba2d-4d76-a74f-1e72518ce95b tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:34.424610 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7ac4c934-ba2d-4d76-a74f-1e72518ce95b tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:34.425284 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7ac4c934-ba2d-4d76-a74f-1e72518ce95b tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:34.425733 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7ac4c934-ba2d-4d76-a74f-1e72518ce95b tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:34.426905 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-7ac4c934-ba2d-4d76-a74f-1e72518ce95b tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:34.562140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-7ac4c934-ba2d-4d76-a74f-1e72518ce95b tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:34.570537 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-7ac4c934-ba2d-4d76-a74f-1e72518ce95b tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1516 microversion: 2.1 time: 0.157748 Aug 24 04:05:34.571110 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 554/1102] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:34 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:35.592338 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-994821d1-3861-446b-ac0b-61a8bfb119e3 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:35.592955 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-994821d1-3861-446b-ac0b-61a8bfb119e3 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:35.600296 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-994821d1-3861-446b-ac0b-61a8bfb119e3 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:35.600788 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-994821d1-3861-446b-ac0b-61a8bfb119e3 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:35.601231 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-994821d1-3861-446b-ac0b-61a8bfb119e3 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:35.601927 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-994821d1-3861-446b-ac0b-61a8bfb119e3 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:35.602387 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-994821d1-3861-446b-ac0b-61a8bfb119e3 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:35.602845 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-994821d1-3861-446b-ac0b-61a8bfb119e3 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:35.738702 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-994821d1-3861-446b-ac0b-61a8bfb119e3 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:35.746798 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-994821d1-3861-446b-ac0b-61a8bfb119e3 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1516 microversion: 2.1 time: 0.158372 Aug 24 04:05:35.747411 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 549/1103] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:35 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:36.768712 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-d88f0043-2c35-4a4f-b0fc-0de24f8f1aea tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:36.769313 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-d88f0043-2c35-4a4f-b0fc-0de24f8f1aea tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:36.776183 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d88f0043-2c35-4a4f-b0fc-0de24f8f1aea tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:36.776652 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d88f0043-2c35-4a4f-b0fc-0de24f8f1aea tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:36.777075 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d88f0043-2c35-4a4f-b0fc-0de24f8f1aea tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:36.777749 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d88f0043-2c35-4a4f-b0fc-0de24f8f1aea tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:36.778191 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d88f0043-2c35-4a4f-b0fc-0de24f8f1aea tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:36.778641 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-d88f0043-2c35-4a4f-b0fc-0de24f8f1aea tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:36.915921 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-d88f0043-2c35-4a4f-b0fc-0de24f8f1aea tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:36.923672 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-d88f0043-2c35-4a4f-b0fc-0de24f8f1aea tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1518 microversion: 2.1 time: 0.159016 Aug 24 04:05:36.924235 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 555/1104] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:36 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:37.523793 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:05:37.524409 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Wed Aug 24 04:05:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:05:37.945438 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4ce4d39a-6e87-4a3f-acac-4c3209f07974 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:37.945995 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4ce4d39a-6e87-4a3f-acac-4c3209f07974 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:37.952699 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4ce4d39a-6e87-4a3f-acac-4c3209f07974 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:37.953185 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4ce4d39a-6e87-4a3f-acac-4c3209f07974 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:37.953624 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4ce4d39a-6e87-4a3f-acac-4c3209f07974 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:37.954322 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4ce4d39a-6e87-4a3f-acac-4c3209f07974 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:37.954815 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4ce4d39a-6e87-4a3f-acac-4c3209f07974 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:37.955256 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4ce4d39a-6e87-4a3f-acac-4c3209f07974 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:38.092704 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-4ce4d39a-6e87-4a3f-acac-4c3209f07974 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:38.100634 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4ce4d39a-6e87-4a3f-acac-4c3209f07974 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1574 microversion: 2.1 time: 0.159311 Aug 24 04:05:38.101250 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 550/1105] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:37 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:39.124019 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-da94aca0-6c60-4634-a699-f2dc9e8a6fba tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:39.124655 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-da94aca0-6c60-4634-a699-f2dc9e8a6fba tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:39.132757 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-da94aca0-6c60-4634-a699-f2dc9e8a6fba tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:39.133239 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-da94aca0-6c60-4634-a699-f2dc9e8a6fba tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:39.133848 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-da94aca0-6c60-4634-a699-f2dc9e8a6fba tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:39.134369 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-da94aca0-6c60-4634-a699-f2dc9e8a6fba tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:39.134842 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-da94aca0-6c60-4634-a699-f2dc9e8a6fba tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:39.135262 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-da94aca0-6c60-4634-a699-f2dc9e8a6fba tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:39.280618 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-da94aca0-6c60-4634-a699-f2dc9e8a6fba tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:39.288945 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-da94aca0-6c60-4634-a699-f2dc9e8a6fba tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1574 microversion: 2.1 time: 0.168894 Aug 24 04:05:39.289505 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 556/1106] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:39 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1574 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:40.218646 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:05:40.219297 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Wed Aug 24 04:05:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:05:40.309694 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2f24769c-e715-44b3-887c-f30f5a186fd8 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:40.310225 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2f24769c-e715-44b3-887c-f30f5a186fd8 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:40.316791 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2f24769c-e715-44b3-887c-f30f5a186fd8 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:40.317280 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2f24769c-e715-44b3-887c-f30f5a186fd8 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:40.317715 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2f24769c-e715-44b3-887c-f30f5a186fd8 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:40.318404 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2f24769c-e715-44b3-887c-f30f5a186fd8 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:40.318890 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2f24769c-e715-44b3-887c-f30f5a186fd8 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:40.319312 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2f24769c-e715-44b3-887c-f30f5a186fd8 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:40.456963 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-2f24769c-e715-44b3-887c-f30f5a186fd8 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:40.464887 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2f24769c-e715-44b3-887c-f30f5a186fd8 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1574 microversion: 2.1 time: 0.159149 Aug 24 04:05:40.465463 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 551/1107] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:40 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:41.486122 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-220078a3-8c03-4335-b1e5-1f564372cf91 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:41.486762 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-220078a3-8c03-4335-b1e5-1f564372cf91 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:41.495714 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-220078a3-8c03-4335-b1e5-1f564372cf91 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:41.496198 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-220078a3-8c03-4335-b1e5-1f564372cf91 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:41.496634 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-220078a3-8c03-4335-b1e5-1f564372cf91 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:41.497336 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-220078a3-8c03-4335-b1e5-1f564372cf91 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:41.497789 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-220078a3-8c03-4335-b1e5-1f564372cf91 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:41.498219 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-220078a3-8c03-4335-b1e5-1f564372cf91 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:41.552950 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:05:41.553186 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Wed Aug 24 04:05:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b (ip 10.222.0.82) !!! Aug 24 04:05:41.631258 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-220078a3-8c03-4335-b1e5-1f564372cf91 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:41.638913 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-220078a3-8c03-4335-b1e5-1f564372cf91 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1574 microversion: 2.1 time: 0.156614 Aug 24 04:05:41.639475 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 557/1108] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:41 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:42.662163 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-76c0f1b7-cfa0-4c8b-bbe2-5750cf145c71 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:42.662788 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-76c0f1b7-cfa0-4c8b-bbe2-5750cf145c71 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:42.669378 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76c0f1b7-cfa0-4c8b-bbe2-5750cf145c71 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:42.669854 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76c0f1b7-cfa0-4c8b-bbe2-5750cf145c71 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:42.670281 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76c0f1b7-cfa0-4c8b-bbe2-5750cf145c71 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:42.670988 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76c0f1b7-cfa0-4c8b-bbe2-5750cf145c71 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:42.671436 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76c0f1b7-cfa0-4c8b-bbe2-5750cf145c71 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:42.671849 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-76c0f1b7-cfa0-4c8b-bbe2-5750cf145c71 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:42.801960 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-76c0f1b7-cfa0-4c8b-bbe2-5750cf145c71 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:42.809742 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-76c0f1b7-cfa0-4c8b-bbe2-5750cf145c71 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1574 microversion: 2.1 time: 0.152531 Aug 24 04:05:42.810310 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 552/1109] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:42 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:43.830788 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-674f1df5-ca0b-4463-9351-d038341e978f tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:43.831401 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-674f1df5-ca0b-4463-9351-d038341e978f tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:43.838080 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-674f1df5-ca0b-4463-9351-d038341e978f tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:43.838595 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-674f1df5-ca0b-4463-9351-d038341e978f tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:43.839032 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-674f1df5-ca0b-4463-9351-d038341e978f tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:43.839725 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-674f1df5-ca0b-4463-9351-d038341e978f tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:43.840177 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-674f1df5-ca0b-4463-9351-d038341e978f tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:43.840600 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-674f1df5-ca0b-4463-9351-d038341e978f tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:43.977026 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-674f1df5-ca0b-4463-9351-d038341e978f tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:43.987567 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-674f1df5-ca0b-4463-9351-d038341e978f tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1574 microversion: 2.1 time: 0.157874 Aug 24 04:05:43.987567 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 558/1110] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:43 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:45.008508 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3ad025f0-eef2-4389-8601-1a863f62d623 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:45.009128 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3ad025f0-eef2-4389-8601-1a863f62d623 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:45.015769 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3ad025f0-eef2-4389-8601-1a863f62d623 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:45.016250 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3ad025f0-eef2-4389-8601-1a863f62d623 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:45.016679 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3ad025f0-eef2-4389-8601-1a863f62d623 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:45.017368 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3ad025f0-eef2-4389-8601-1a863f62d623 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:45.017816 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3ad025f0-eef2-4389-8601-1a863f62d623 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:45.018232 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3ad025f0-eef2-4389-8601-1a863f62d623 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:45.152057 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-3ad025f0-eef2-4389-8601-1a863f62d623 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:45.159812 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3ad025f0-eef2-4389-8601-1a863f62d623 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1574 microversion: 2.1 time: 0.156344 Aug 24 04:05:45.160981 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 553/1111] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:45 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:46.181151 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-f5022f01-e0b7-463e-ada1-604a018e630e tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:46.181833 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-f5022f01-e0b7-463e-ada1-604a018e630e tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:46.188201 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f5022f01-e0b7-463e-ada1-604a018e630e tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:46.188681 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f5022f01-e0b7-463e-ada1-604a018e630e tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:46.189114 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f5022f01-e0b7-463e-ada1-604a018e630e tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:46.189799 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f5022f01-e0b7-463e-ada1-604a018e630e tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:46.190247 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f5022f01-e0b7-463e-ada1-604a018e630e tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:46.190694 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f5022f01-e0b7-463e-ada1-604a018e630e tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:46.323306 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-f5022f01-e0b7-463e-ada1-604a018e630e tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:46.331091 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-f5022f01-e0b7-463e-ada1-604a018e630e tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1574 microversion: 2.1 time: 0.153802 Aug 24 04:05:46.331643 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 559/1112] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:46 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:47.353571 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-7dc8c04e-a1e5-40b1-8422-a12f9a85a0e1 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:47.354187 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-7dc8c04e-a1e5-40b1-8422-a12f9a85a0e1 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:47.360707 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7dc8c04e-a1e5-40b1-8422-a12f9a85a0e1 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:47.361189 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7dc8c04e-a1e5-40b1-8422-a12f9a85a0e1 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:47.361678 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7dc8c04e-a1e5-40b1-8422-a12f9a85a0e1 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:47.362377 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7dc8c04e-a1e5-40b1-8422-a12f9a85a0e1 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:47.362866 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7dc8c04e-a1e5-40b1-8422-a12f9a85a0e1 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:47.365425 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-7dc8c04e-a1e5-40b1-8422-a12f9a85a0e1 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:47.494634 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-7dc8c04e-a1e5-40b1-8422-a12f9a85a0e1 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:47.502782 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-7dc8c04e-a1e5-40b1-8422-a12f9a85a0e1 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1574 microversion: 2.1 time: 0.153196 Aug 24 04:05:47.503434 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 554/1113] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:47 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:48.527831 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-ea22a715-9b0d-4fbd-8842-f7c36a432723 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:48.528466 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-ea22a715-9b0d-4fbd-8842-f7c36a432723 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:48.535017 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ea22a715-9b0d-4fbd-8842-f7c36a432723 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:48.536206 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ea22a715-9b0d-4fbd-8842-f7c36a432723 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:48.536649 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ea22a715-9b0d-4fbd-8842-f7c36a432723 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:48.537342 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ea22a715-9b0d-4fbd-8842-f7c36a432723 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:48.537799 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ea22a715-9b0d-4fbd-8842-f7c36a432723 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:48.538254 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-ea22a715-9b0d-4fbd-8842-f7c36a432723 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:48.671227 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-ea22a715-9b0d-4fbd-8842-f7c36a432723 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:48.680235 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-ea22a715-9b0d-4fbd-8842-f7c36a432723 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1574 microversion: 2.1 time: 0.156255 Aug 24 04:05:48.690793 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 560/1114] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:48 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:49.366197 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-483ee88f-3c39-4ae6-844f-2f826ce1abdd req-d51b524d-fdf3-41c8-b256-f9f352f4b225 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a594d5f2-3dd6-44f5-88bb-56396538864b", "name": "network-vif-plugged", "status": "completed", "tag": "3f135d8e-5df6-49a2-8a9b-f5b220e13806"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:05:49.376283 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-483ee88f-3c39-4ae6-844f-2f826ce1abdd req-d51b524d-fdf3-41c8-b256-f9f352f4b225 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:49.376762 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-483ee88f-3c39-4ae6-844f-2f826ce1abdd req-d51b524d-fdf3-41c8-b256-f9f352f4b225 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:49.377192 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-483ee88f-3c39-4ae6-844f-2f826ce1abdd req-d51b524d-fdf3-41c8-b256-f9f352f4b225 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:49.380740 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:05:49.389693 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-483ee88f-3c39-4ae6-844f-2f826ce1abdd req-d51b524d-fdf3-41c8-b256-f9f352f4b225 service nova] Creating event network-vif-plugged:3f135d8e-5df6-49a2-8a9b-f5b220e13806 for instance a594d5f2-3dd6-44f5-88bb-56396538864b on hv-cinder-85426 Aug 24 04:05:49.395036 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-483ee88f-3c39-4ae6-844f-2f826ce1abdd req-d51b524d-fdf3-41c8-b256-f9f352f4b225 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033030 Aug 24 04:05:49.395600 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 555/1115] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 04:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:05:49.701534 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-74771ad7-818a-4186-90f5-b616477af4f7 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:49.702209 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-74771ad7-818a-4186-90f5-b616477af4f7 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:49.709387 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-74771ad7-818a-4186-90f5-b616477af4f7 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:49.709871 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-74771ad7-818a-4186-90f5-b616477af4f7 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:49.710303 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-74771ad7-818a-4186-90f5-b616477af4f7 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:49.711036 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-74771ad7-818a-4186-90f5-b616477af4f7 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:49.711484 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-74771ad7-818a-4186-90f5-b616477af4f7 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:49.711905 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-74771ad7-818a-4186-90f5-b616477af4f7 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:49.911119 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-74771ad7-818a-4186-90f5-b616477af4f7 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:49.918646 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-74771ad7-818a-4186-90f5-b616477af4f7 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1574 microversion: 2.1 time: 0.220939 Aug 24 04:05:49.919212 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 561/1116] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:49 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1574 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:50.941479 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c768b96e-407c-4cf0-8123-8f4b94f68740 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:50.942175 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c768b96e-407c-4cf0-8123-8f4b94f68740 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:50.948706 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c768b96e-407c-4cf0-8123-8f4b94f68740 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:50.949185 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c768b96e-407c-4cf0-8123-8f4b94f68740 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:50.949613 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c768b96e-407c-4cf0-8123-8f4b94f68740 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:50.950302 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c768b96e-407c-4cf0-8123-8f4b94f68740 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:50.950789 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c768b96e-407c-4cf0-8123-8f4b94f68740 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:50.951210 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c768b96e-407c-4cf0-8123-8f4b94f68740 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:51.088193 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-c768b96e-407c-4cf0-8123-8f4b94f68740 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:51.095972 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c768b96e-407c-4cf0-8123-8f4b94f68740 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1574 microversion: 2.1 time: 0.159664 Aug 24 04:05:51.096542 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 556/1117] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:50 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:52.120348 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-39272ea6-eea8-43d7-8b3e-67ada6b61a00 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:52.120956 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-39272ea6-eea8-43d7-8b3e-67ada6b61a00 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:52.127095 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-39272ea6-eea8-43d7-8b3e-67ada6b61a00 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:52.127590 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-39272ea6-eea8-43d7-8b3e-67ada6b61a00 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:52.128001 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-39272ea6-eea8-43d7-8b3e-67ada6b61a00 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:52.128696 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-39272ea6-eea8-43d7-8b3e-67ada6b61a00 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:52.129813 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-39272ea6-eea8-43d7-8b3e-67ada6b61a00 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:52.130126 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-39272ea6-eea8-43d7-8b3e-67ada6b61a00 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:52.266933 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-39272ea6-eea8-43d7-8b3e-67ada6b61a00 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:52.278249 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-39272ea6-eea8-43d7-8b3e-67ada6b61a00 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1561 microversion: 2.1 time: 0.161918 Aug 24 04:05:52.278802 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 562/1118] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:52 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:06:58.601108 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e7cf8024-f831-403f-aa6f-f0ee8800c479] AMQP server on 10.222.0.82:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 04:06:58.601667 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:06:58.605929 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bd7df884-55a5-4e73-8da5-6a5ad4fff5b1 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-121872458", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-166112542", "security_groups": [{"name": "tempest-secgroup-smoke-1291274157"}], "block_device_mapping_v2": [{"uuid": "6f5e9f42-9a1f-456a-ba00-12d150fe335c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "01c2e76d-69cf-4147-aee5-37246a863c64"}]}} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:06:58.717239 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.network.neutron [None req-bd7df884-55a5-4e73-8da5-6a5ad4fff5b1 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] validate_networks() for [('01c2e76d-69cf-4147-aee5-37246a863c64', None, None, None, None, None)] {{(pid=127870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:06:59.099316 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-bd7df884-55a5-4e73-8da5-6a5ad4fff5b1 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Flavor limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:06:59.099733 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-bd7df884-55a5-4e73-8da5-6a5ad4fff5b1 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Image limits 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:06:59.100200 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-bd7df884-55a5-4e73-8da5-6a5ad4fff5b1 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Flavor pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:06:59.100600 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-bd7df884-55a5-4e73-8da5-6a5ad4fff5b1 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Image pref 0:0:0 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:06:59.101003 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.virt.hardware [None req-bd7df884-55a5-4e73-8da5-6a5ad4fff5b1 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:06:59.109856 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bd7df884-55a5-4e73-8da5-6a5ad4fff5b1 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:59.110325 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bd7df884-55a5-4e73-8da5-6a5ad4fff5b1 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:59.110786 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bd7df884-55a5-4e73-8da5-6a5ad4fff5b1 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:59.111497 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bd7df884-55a5-4e73-8da5-6a5ad4fff5b1 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:59.111967 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bd7df884-55a5-4e73-8da5-6a5ad4fff5b1 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:59.112378 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bd7df884-55a5-4e73-8da5-6a5ad4fff5b1 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:59.134331 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.quota [None req-bd7df884-55a5-4e73-8da5-6a5ad4fff5b1 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Getting quotas for project 8d390e7ad1454a8182258cd72bea4fa5. Resources: {'instances', 'cores', 'ram'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:06:59.138435 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.quota [None req-bd7df884-55a5-4e73-8da5-6a5ad4fff5b1 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Getting quotas for user 34d452ce6a1245c192acf8c87651fe92 and project 8d390e7ad1454a8182258cd72bea4fa5. Resources: {'instances', 'cores', 'ram'} {{(pid=127870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:06:59.196035 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bd7df884-55a5-4e73-8da5-6a5ad4fff5b1 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Going to run 1 instances... {{(pid=127870) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:06:59.198213 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bd7df884-55a5-4e73-8da5-6a5ad4fff5b1 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6f5e9f42-9a1f-456a-ba00-12d150fe335c',volume_size=None,volume_type=None)] {{(pid=127870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:06:59.609084 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO oslo.messaging._drivers.impl_rabbit [-] [e7cf8024-f831-403f-aa6f-f0ee8800c479] Reconnected to AMQP server on 10.222.0.82:5672 via [amqp] client with port 52044. Aug 24 04:06:59.677714 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bd7df884-55a5-4e73-8da5-6a5ad4fff5b1 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.078997 Aug 24 04:06:59.678355 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 557/1119] 10.222.0.82 () {60 vars in 1147 bytes} [Wed Aug 24 04:06:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 1080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:06:59.687436 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_api:SELECT=29 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:06:59.697543 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell1:SELECT=85 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:06:59.697543 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-6f567cdb-3bca-4521-a398-01b0a5ee1c36 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:59.697543 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-6f567cdb-3bca-4521-a398-01b0a5ee1c36 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:06:59.750123 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-6f567cdb-3bca-4521-a398-01b0a5ee1c36 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:06:59.757992 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-6f567cdb-3bca-4521-a398-01b0a5ee1c36 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d" status: 200 len: 1093 microversion: 2.1 time: 0.072762 Aug 24 04:06:59.758593 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 563/1120] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:06:59 2022] GET /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d => generated 1093 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:07:00.778889 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-807519b8-c891-4773-8f0a-0a426275bda5 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:00.779506 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-807519b8-c891-4773-8f0a-0a426275bda5 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:07:00.786636 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-807519b8-c891-4773-8f0a-0a426275bda5 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:00.787122 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-807519b8-c891-4773-8f0a-0a426275bda5 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:00.787582 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-807519b8-c891-4773-8f0a-0a426275bda5 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:00.788258 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-807519b8-c891-4773-8f0a-0a426275bda5 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:00.788715 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-807519b8-c891-4773-8f0a-0a426275bda5 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:00.789142 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-807519b8-c891-4773-8f0a-0a426275bda5 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:00.852804 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-807519b8-c891-4773-8f0a-0a426275bda5 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:07:00.860759 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-807519b8-c891-4773-8f0a-0a426275bda5 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d" status: 200 len: 1143 microversion: 2.1 time: 0.086125 Aug 24 04:07:00.861192 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 558/1121] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:07:00 2022] GET /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d => generated 1143 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:07:01.883257 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-55500bf1-21b4-4529-9200-14a294159d8e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:01.884017 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-55500bf1-21b4-4529-9200-14a294159d8e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:07:01.891143 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-55500bf1-21b4-4529-9200-14a294159d8e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:01.891702 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-55500bf1-21b4-4529-9200-14a294159d8e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:01.892217 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-55500bf1-21b4-4529-9200-14a294159d8e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:01.892977 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-55500bf1-21b4-4529-9200-14a294159d8e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:01.893435 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-55500bf1-21b4-4529-9200-14a294159d8e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:01.894416 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-55500bf1-21b4-4529-9200-14a294159d8e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:01.971045 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-55500bf1-21b4-4529-9200-14a294159d8e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:07:01.980542 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-55500bf1-21b4-4529-9200-14a294159d8e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d" status: 200 len: 1199 microversion: 2.1 time: 0.101323 Aug 24 04:07:01.981203 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 564/1122] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:07:01 2022] GET /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d => generated 1199 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:07:03.001658 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5b9e10e9-bb61-4159-b20a-b154ef6f54e0 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:03.002578 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5b9e10e9-bb61-4159-b20a-b154ef6f54e0 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:07:03.010759 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b9e10e9-bb61-4159-b20a-b154ef6f54e0 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:03.011239 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b9e10e9-bb61-4159-b20a-b154ef6f54e0 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:03.011932 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b9e10e9-bb61-4159-b20a-b154ef6f54e0 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:03.012802 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b9e10e9-bb61-4159-b20a-b154ef6f54e0 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:03.013461 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b9e10e9-bb61-4159-b20a-b154ef6f54e0 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:03.013882 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5b9e10e9-bb61-4159-b20a-b154ef6f54e0 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:03.155136 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-5b9e10e9-bb61-4159-b20a-b154ef6f54e0 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:07:03.163277 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5b9e10e9-bb61-4159-b20a-b154ef6f54e0 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d" status: 200 len: 1277 microversion: 2.1 time: 0.165579 Aug 24 04:07:03.163855 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 559/1123] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:07:02 2022] GET /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:07:03.456230 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-d4811480-8f2e-4b3c-aec8-b3bf54c66e7d req-7ca06e05-cf2c-45f2-8596-c278b3885b53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d", "tag": "21a3dbf8-8653-41f4-8fea-d2ace7b0a087"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:07:03.466257 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-d4811480-8f2e-4b3c-aec8-b3bf54c66e7d req-7ca06e05-cf2c-45f2-8596-c278b3885b53 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:03.466880 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-d4811480-8f2e-4b3c-aec8-b3bf54c66e7d req-7ca06e05-cf2c-45f2-8596-c278b3885b53 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:03.467304 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-d4811480-8f2e-4b3c-aec8-b3bf54c66e7d req-7ca06e05-cf2c-45f2-8596-c278b3885b53 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:03.478241 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-d4811480-8f2e-4b3c-aec8-b3bf54c66e7d req-7ca06e05-cf2c-45f2-8596-c278b3885b53 service nova] Creating event network-changed:21a3dbf8-8653-41f4-8fea-d2ace7b0a087 for instance 5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d on hv-cinder-85426 Aug 24 04:07:03.484197 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-d4811480-8f2e-4b3c-aec8-b3bf54c66e7d req-7ca06e05-cf2c-45f2-8596-c278b3885b53 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031615 Aug 24 04:07:03.484951 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 565/1124] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 04:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:07:04.185091 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-185c44e8-ccab-4d24-a26e-9a59f265f363 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:04.185701 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-185c44e8-ccab-4d24-a26e-9a59f265f363 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:07:04.193609 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-185c44e8-ccab-4d24-a26e-9a59f265f363 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:04.194087 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-185c44e8-ccab-4d24-a26e-9a59f265f363 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:04.194527 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-185c44e8-ccab-4d24-a26e-9a59f265f363 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:04.195242 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-185c44e8-ccab-4d24-a26e-9a59f265f363 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:04.195688 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-185c44e8-ccab-4d24-a26e-9a59f265f363 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:04.196110 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-185c44e8-ccab-4d24-a26e-9a59f265f363 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:04.335686 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-185c44e8-ccab-4d24-a26e-9a59f265f363 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:07:04.343536 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-185c44e8-ccab-4d24-a26e-9a59f265f363 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d" status: 200 len: 1265 microversion: 2.1 time: 0.162348 Aug 24 04:07:04.344103 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 560/1125] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:07:04 2022] GET /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:07:05.365842 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-02c2ec9c-0b92-4241-b2c6-ba702348d36b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:05.366438 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-02c2ec9c-0b92-4241-b2c6-ba702348d36b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:07:05.372525 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-02c2ec9c-0b92-4241-b2c6-ba702348d36b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:05.372999 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-02c2ec9c-0b92-4241-b2c6-ba702348d36b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:05.373434 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-02c2ec9c-0b92-4241-b2c6-ba702348d36b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:05.374105 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-02c2ec9c-0b92-4241-b2c6-ba702348d36b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:05.374576 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-02c2ec9c-0b92-4241-b2c6-ba702348d36b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:05.374995 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-02c2ec9c-0b92-4241-b2c6-ba702348d36b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:05.506610 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-02c2ec9c-0b92-4241-b2c6-ba702348d36b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:07:05.514195 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-02c2ec9c-0b92-4241-b2c6-ba702348d36b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d" status: 200 len: 1265 microversion: 2.1 time: 0.153102 Aug 24 04:07:05.514854 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 566/1126] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:07:05 2022] GET /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:07:06.535461 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-706af252-5507-45bf-8141-f086bd17211e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:06.536050 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-706af252-5507-45bf-8141-f086bd17211e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:07:06.542436 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-706af252-5507-45bf-8141-f086bd17211e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:06.542947 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-706af252-5507-45bf-8141-f086bd17211e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:06.543380 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-706af252-5507-45bf-8141-f086bd17211e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:06.544067 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-706af252-5507-45bf-8141-f086bd17211e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:06.544515 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-706af252-5507-45bf-8141-f086bd17211e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:06.544931 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-706af252-5507-45bf-8141-f086bd17211e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:06.682651 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-706af252-5507-45bf-8141-f086bd17211e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:07:06.690951 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-706af252-5507-45bf-8141-f086bd17211e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d" status: 200 len: 1265 microversion: 2.1 time: 0.158768 Aug 24 04:07:06.691750 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 561/1127] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:07:06 2022] GET /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:07:06.747848 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-efa05f8a-f3f9-46c5-9c01-06c6744c3909 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:06.748516 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-efa05f8a-f3f9-46c5-9c01-06c6744c3909 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:07:06.751330 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [req-c9c6c1f7-c2d2-4688-a605-15eaaa51f36c req-746578b2-b50a-4c6a-a56a-a4fb65ff80e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a594d5f2-3dd6-44f5-88bb-56396538864b", "tag": "3f135d8e-5df6-49a2-8a9b-f5b220e13806"}]} {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:07:06.756528 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-efa05f8a-f3f9-46c5-9c01-06c6744c3909 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:06.757088 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-efa05f8a-f3f9-46c5-9c01-06c6744c3909 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:06.757591 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-efa05f8a-f3f9-46c5-9c01-06c6744c3909 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:06.758362 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-efa05f8a-f3f9-46c5-9c01-06c6744c3909 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:06.759070 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-efa05f8a-f3f9-46c5-9c01-06c6744c3909 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:06.759497 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-efa05f8a-f3f9-46c5-9c01-06c6744c3909 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:06.762213 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-c9c6c1f7-c2d2-4688-a605-15eaaa51f36c req-746578b2-b50a-4c6a-a56a-a4fb65ff80e4 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:06.762812 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-c9c6c1f7-c2d2-4688-a605-15eaaa51f36c req-746578b2-b50a-4c6a-a56a-a4fb65ff80e4 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:06.763310 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [req-c9c6c1f7-c2d2-4688-a605-15eaaa51f36c req-746578b2-b50a-4c6a-a56a-a4fb65ff80e4 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:06.775820 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.compute.server_external_events [req-c9c6c1f7-c2d2-4688-a605-15eaaa51f36c req-746578b2-b50a-4c6a-a56a-a4fb65ff80e4 service nova] Creating event network-changed:3f135d8e-5df6-49a2-8a9b-f5b220e13806 for instance a594d5f2-3dd6-44f5-88bb-56396538864b on hv-cinder-85426 Aug 24 04:07:06.782541 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [req-c9c6c1f7-c2d2-4688-a605-15eaaa51f36c req-746578b2-b50a-4c6a-a56a-a4fb65ff80e4 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033560 Aug 24 04:07:06.782541 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 562/1128] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 04:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:07:06.788196 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-efa05f8a-f3f9-46c5-9c01-06c6744c3909 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Going to try to terminate instance {{(pid=127869) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:07:07.106523 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-efa05f8a-f3f9-46c5-9c01-06c6744c3909 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "DELETE /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 204 len: 0 microversion: 2.1 time: 0.362747 Aug 24 04:07:07.107233 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 567/1129] 10.222.0.82 () {58 vars in 1239 bytes} [Wed Aug 24 04:07:06 2022] DELETE /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:07:07.119203 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f9d9c62a-ba51-4bef-a8f4-9fc8103faa7a tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:07.120171 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f9d9c62a-ba51-4bef-a8f4-9fc8103faa7a tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:07:07.126374 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f9d9c62a-ba51-4bef-a8f4-9fc8103faa7a tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:07.126822 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f9d9c62a-ba51-4bef-a8f4-9fc8103faa7a tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:07.127256 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f9d9c62a-ba51-4bef-a8f4-9fc8103faa7a tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:07.128156 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f9d9c62a-ba51-4bef-a8f4-9fc8103faa7a tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:07.128619 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f9d9c62a-ba51-4bef-a8f4-9fc8103faa7a tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:07.129139 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f9d9c62a-ba51-4bef-a8f4-9fc8103faa7a tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:07.266889 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-f9d9c62a-ba51-4bef-a8f4-9fc8103faa7a tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:07:07.275180 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f9d9c62a-ba51-4bef-a8f4-9fc8103faa7a tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1567 microversion: 2.1 time: 0.160155 Aug 24 04:07:07.276024 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 563/1130] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:07:07 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:07:07.713893 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-f1ddc73a-e90a-42bc-a337-f553b0097328 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:07.714665 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-f1ddc73a-e90a-42bc-a337-f553b0097328 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:07:07.722288 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f1ddc73a-e90a-42bc-a337-f553b0097328 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:07.723414 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f1ddc73a-e90a-42bc-a337-f553b0097328 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:07.723855 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f1ddc73a-e90a-42bc-a337-f553b0097328 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:07.724837 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f1ddc73a-e90a-42bc-a337-f553b0097328 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:07.725294 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f1ddc73a-e90a-42bc-a337-f553b0097328 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:07.725715 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f1ddc73a-e90a-42bc-a337-f553b0097328 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:07.867870 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-f1ddc73a-e90a-42bc-a337-f553b0097328 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:07:07.876880 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-f1ddc73a-e90a-42bc-a337-f553b0097328 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d" status: 200 len: 1265 microversion: 2.1 time: 0.167598 Aug 24 04:07:07.877437 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 568/1131] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:07:07 2022] GET /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:07:08.296609 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-c7d6efbe-fb58-43ea-b2ac-74c75e37fde0 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:08.297282 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-c7d6efbe-fb58-43ea-b2ac-74c75e37fde0 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:07:08.304673 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c7d6efbe-fb58-43ea-b2ac-74c75e37fde0 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:08.305138 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c7d6efbe-fb58-43ea-b2ac-74c75e37fde0 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:08.305568 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c7d6efbe-fb58-43ea-b2ac-74c75e37fde0 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:08.306258 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c7d6efbe-fb58-43ea-b2ac-74c75e37fde0 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:08.306741 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c7d6efbe-fb58-43ea-b2ac-74c75e37fde0 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:08.307164 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-c7d6efbe-fb58-43ea-b2ac-74c75e37fde0 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:08.448045 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-c7d6efbe-fb58-43ea-b2ac-74c75e37fde0 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:07:08.456693 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-c7d6efbe-fb58-43ea-b2ac-74c75e37fde0 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1567 microversion: 2.1 time: 0.163380 Aug 24 04:07:08.459019 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 564/1132] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:07:08 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:07:08.898895 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-8b090f11-e29f-4c11-a4cd-e35fd06ea0de tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:08.899479 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-8b090f11-e29f-4c11-a4cd-e35fd06ea0de tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:07:08.905763 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8b090f11-e29f-4c11-a4cd-e35fd06ea0de tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:08.906241 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8b090f11-e29f-4c11-a4cd-e35fd06ea0de tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:08.906704 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8b090f11-e29f-4c11-a4cd-e35fd06ea0de tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:08.907392 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8b090f11-e29f-4c11-a4cd-e35fd06ea0de tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:08.907841 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8b090f11-e29f-4c11-a4cd-e35fd06ea0de tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:08.908261 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-8b090f11-e29f-4c11-a4cd-e35fd06ea0de tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:09.139113 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-8b090f11-e29f-4c11-a4cd-e35fd06ea0de tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:07:09.147528 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-8b090f11-e29f-4c11-a4cd-e35fd06ea0de tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d" status: 200 len: 1265 microversion: 2.1 time: 0.252664 Aug 24 04:07:09.148105 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 569/1133] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:07:08 2022] GET /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:07:09.480256 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-81f8d7e9-06ad-409b-8f58-6bc4261fe2b5 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:09.480947 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-81f8d7e9-06ad-409b-8f58-6bc4261fe2b5 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:07:09.483994 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=2 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:07:09.484691 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell0:SELECT=6 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:07:09.490698 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81f8d7e9-06ad-409b-8f58-6bc4261fe2b5 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:09.495679 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81f8d7e9-06ad-409b-8f58-6bc4261fe2b5 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:09.495679 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81f8d7e9-06ad-409b-8f58-6bc4261fe2b5 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:09.495679 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81f8d7e9-06ad-409b-8f58-6bc4261fe2b5 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:09.495679 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81f8d7e9-06ad-409b-8f58-6bc4261fe2b5 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:09.496613 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-81f8d7e9-06ad-409b-8f58-6bc4261fe2b5 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:09.532001 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-1110d1d0-931e-457f-976c-eeb6af43d582 req-b92342d6-9637-435c-8e85-52504f5b19d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a594d5f2-3dd6-44f5-88bb-56396538864b", "name": "network-vif-deleted", "tag": "3f135d8e-5df6-49a2-8a9b-f5b220e13806"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:07:09.543225 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-1110d1d0-931e-457f-976c-eeb6af43d582 req-b92342d6-9637-435c-8e85-52504f5b19d8 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:09.544031 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-1110d1d0-931e-457f-976c-eeb6af43d582 req-b92342d6-9637-435c-8e85-52504f5b19d8 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:09.544217 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-1110d1d0-931e-457f-976c-eeb6af43d582 req-b92342d6-9637-435c-8e85-52504f5b19d8 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:09.556763 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-1110d1d0-931e-457f-976c-eeb6af43d582 req-b92342d6-9637-435c-8e85-52504f5b19d8 service nova] Creating event network-vif-deleted:3f135d8e-5df6-49a2-8a9b-f5b220e13806 for instance a594d5f2-3dd6-44f5-88bb-56396538864b on hv-cinder-85426 Aug 24 04:07:09.562097 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-81f8d7e9-06ad-409b-8f58-6bc4261fe2b5 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:07:09.562305 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-1110d1d0-931e-457f-976c-eeb6af43d582 req-b92342d6-9637-435c-8e85-52504f5b19d8 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034390 Aug 24 04:07:09.562898 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 570/1134] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 04:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:07:09.570925 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-81f8d7e9-06ad-409b-8f58-6bc4261fe2b5 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1382 microversion: 2.1 time: 0.094894 Aug 24 04:07:09.571504 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 565/1135] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:07:09 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1382 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:07:10.168204 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-0fe8070d-effa-46eb-80fd-083052d364df tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:10.168888 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-0fe8070d-effa-46eb-80fd-083052d364df tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:07:10.170925 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell0:SELECT=2 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:07:10.176502 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0fe8070d-effa-46eb-80fd-083052d364df tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:10.176979 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0fe8070d-effa-46eb-80fd-083052d364df tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:10.177488 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0fe8070d-effa-46eb-80fd-083052d364df tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:10.178171 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0fe8070d-effa-46eb-80fd-083052d364df tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:10.178643 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0fe8070d-effa-46eb-80fd-083052d364df tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:10.179062 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-0fe8070d-effa-46eb-80fd-083052d364df tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:10.364312 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-0fe8070d-effa-46eb-80fd-083052d364df tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:07:10.372250 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-0fe8070d-effa-46eb-80fd-083052d364df tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d" status: 200 len: 1265 microversion: 2.1 time: 0.208298 Aug 24 04:07:10.372813 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 571/1136] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:07:10 2022] GET /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d => generated 1265 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:07:10.591654 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-83c37a03-4953-465c-9e86-560f6c390b04 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:10.592219 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-83c37a03-4953-465c-9e86-560f6c390b04 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:07:10.599187 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-83c37a03-4953-465c-9e86-560f6c390b04 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:10.599670 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-83c37a03-4953-465c-9e86-560f6c390b04 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:10.600107 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-83c37a03-4953-465c-9e86-560f6c390b04 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:10.600803 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-83c37a03-4953-465c-9e86-560f6c390b04 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:10.601259 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-83c37a03-4953-465c-9e86-560f6c390b04 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:10.601684 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-83c37a03-4953-465c-9e86-560f6c390b04 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:10.671947 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-83c37a03-4953-465c-9e86-560f6c390b04 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa39ed4cd12348c58eef09330af9c000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4943c05bd844f8d940def9908078748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:07:10.680593 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-83c37a03-4953-465c-9e86-560f6c390b04 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 200 len: 1220 microversion: 2.1 time: 0.092844 Aug 24 04:07:10.681211 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 566/1137] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:07:10 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:07:11.393216 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-fafb41b4-da90-44a3-80bd-474455281920 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:11.394719 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-fafb41b4-da90-44a3-80bd-474455281920 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:07:11.401140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-fafb41b4-da90-44a3-80bd-474455281920 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:11.401619 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-fafb41b4-da90-44a3-80bd-474455281920 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:11.402052 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-fafb41b4-da90-44a3-80bd-474455281920 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:11.402776 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-fafb41b4-da90-44a3-80bd-474455281920 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:11.403227 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-fafb41b4-da90-44a3-80bd-474455281920 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:11.403681 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-fafb41b4-da90-44a3-80bd-474455281920 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:11.543510 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-fafb41b4-da90-44a3-80bd-474455281920 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:07:11.551867 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-fafb41b4-da90-44a3-80bd-474455281920 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d" status: 200 len: 1265 microversion: 2.1 time: 0.162522 Aug 24 04:07:11.552477 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 572/1138] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:07:11 2022] GET /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:07:11.701278 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5f1228a7-ca57-4c6c-909f-efc471901f99 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:11.701889 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-5f1228a7-ca57-4c6c-909f-efc471901f99 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] [instance: a594d5f2-3dd6-44f5-88bb-56396538864b] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:07:11.709052 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5f1228a7-ca57-4c6c-909f-efc471901f99 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:11.709515 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5f1228a7-ca57-4c6c-909f-efc471901f99 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:11.709950 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5f1228a7-ca57-4c6c-909f-efc471901f99 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:11.710672 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5f1228a7-ca57-4c6c-909f-efc471901f99 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:11.711123 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5f1228a7-ca57-4c6c-909f-efc471901f99 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:11.711544 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-5f1228a7-ca57-4c6c-909f-efc471901f99 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:11.725490 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-5f1228a7-ca57-4c6c-909f-efc471901f99 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] HTTP exception thrown: Instance a594d5f2-3dd6-44f5-88bb-56396538864b could not be found. Aug 24 04:07:11.727148 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5f1228a7-ca57-4c6c-909f-efc471901f99 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Request method failure captured: Aug 24 04:07:11.727148 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: request: GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b HTTP/1.1 Aug 24 04:07:11.727148 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept: application/json Aug 24 04:07:11.727148 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept-Encoding: identity Aug 24 04:07:11.727148 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Connection: close Aug 24 04:07:11.727148 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Length: 0 Aug 24 04:07:11.727148 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Type: application/json Aug 24 04:07:11.727148 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Host: 10.222.0.82 Aug 24 04:07:11.727148 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Openstack-System-Scope: None Aug 24 04:07:11.727148 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.11 Aug 24 04:07:11.727148 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Auth-Token: gAAAAABjBaLc9jwb0L09xwBtURbx-ZkhWCCutSA3Zsn6ZSIf6qWv7rOz1oEkehnP2BWUlnkiYkIYXOQtAAFgfEntvvDYrsPXspNNNLu7TZ4FcLtbru623r2PTGQ_Cha90PiyZEuKh2V4A3Sj66bqCzV8uzKXl2FOZ-VBDbWKcpoFehlQ8mxDoZA Aug 24 04:07:11.727148 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Id: None Aug 24 04:07:11.727148 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Name: None Aug 24 04:07:11.727148 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Identity-Status: Confirmed Aug 24 04:07:11.727148 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Is-Admin-Project: True Aug 24 04:07:11.727148 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Id: default Aug 24 04:07:11.727148 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Name: Default Aug 24 04:07:11.727148 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Id: c4943c05bd844f8d940def9908078748 Aug 24 04:07:11.727148 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Name: tempest-TestShelveInstance-1460495316 Aug 24 04:07:11.727148 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Role: member,reader Aug 24 04:07:11.727148 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Roles: member,reader Aug 24 04:07:11.728954 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/c4943c05bd844f8d940def9908078748"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/c4943c05bd844f8d940def9908078748"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/c4943c05bd844f8d940def9908078748"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_c4943c05bd844f8d940def9908078748", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 04:07:11.728954 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant: tempest-TestShelveInstance-1460495316 Aug 24 04:07:11.728954 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Id: c4943c05bd844f8d940def9908078748 Aug 24 04:07:11.728954 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Name: tempest-TestShelveInstance-1460495316 Aug 24 04:07:11.728954 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User: tempest-TestShelveInstance-1460495316-project Aug 24 04:07:11.728954 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Id: default Aug 24 04:07:11.728954 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Name: Default Aug 24 04:07:11.728954 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Id: aa39ed4cd12348c58eef09330af9c000 Aug 24 04:07:11.728954 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Name: tempest-TestShelveInstance-1460495316-project Aug 24 04:07:11.728954 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: method: > Aug 24 04:07:11.728954 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: exception: Instance a594d5f2-3dd6-44f5-88bb-56396538864b could not be found. Aug 24 04:07:11.728954 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: action_args: {'id': 'a594d5f2-3dd6-44f5-88bb-56396538864b'} Aug 24 04:07:11.730059 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:07:11.730059 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:07:11.730059 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:07:11.730059 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:07:11.730059 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:07:11.730059 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:07:11.730059 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:07:11.730059 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:07:11.730059 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:07:11.730059 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:07:11.730059 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a594d5f2-3dd6-44f5-88bb-56396538864b could not be found. Aug 24 04:07:11.730059 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 04:07:11.730059 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:07:11.730059 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 04:07:11.730059 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:07:11.730059 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:07:11.730059 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:07:11.730059 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:07:11.730059 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:07:11.730059 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:07:11.731817 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:07:11.731817 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:07:11.731817 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:07:11.731817 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:07:11.731817 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:07:11.731817 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:07:11.731817 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:07:11.731817 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a594d5f2-3dd6-44f5-88bb-56396538864b could not be found. Aug 24 04:07:11.731817 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 04:07:11.731817 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:07:11.731817 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 04:07:11.731817 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:07:11.731817 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:07:11.731817 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:07:11.731817 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:07:11.731817 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:07:11.731817 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a594d5f2-3dd6-44f5-88bb-56396538864b could not be found. Aug 24 04:07:11.731817 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 04:07:11.733493 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-5f1228a7-ca57-4c6c-909f-efc471901f99 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Returning 404 to user: Instance a594d5f2-3dd6-44f5-88bb-56396538864b could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:07:11.733493 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-5f1228a7-ca57-4c6c-909f-efc471901f99 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b" status: 404 len: 111 microversion: 2.1 time: 0.031134 Aug 24 04:07:11.733493 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 567/1139] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:07:11 2022] GET /compute/v2.1/servers/a594d5f2-3dd6-44f5-88bb-56396538864b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:07:11.984808 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-f285f0aa-2eb8-41d6-87ee-90afe1af23a8 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] Calling method '.version_select at 0x7f1554328940>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:12.095080 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-f285f0aa-2eb8-41d6-87ee-90afe1af23a8 tempest-TestShelveInstance-1460495316 tempest-TestShelveInstance-1460495316-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1911518088" status: 202 len: 0 microversion: 2.1 time: 0.114130 Aug 24 04:07:12.095584 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 573/1140] 10.222.0.82 () {58 vars in 1254 bytes} [Wed Aug 24 04:07:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1911518088 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:07:12.573072 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4e8e688c-6638-40b5-ba53-0e205f399188 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:12.574032 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4e8e688c-6638-40b5-ba53-0e205f399188 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:07:12.582989 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4e8e688c-6638-40b5-ba53-0e205f399188 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:12.583483 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4e8e688c-6638-40b5-ba53-0e205f399188 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:12.583923 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4e8e688c-6638-40b5-ba53-0e205f399188 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:12.584633 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4e8e688c-6638-40b5-ba53-0e205f399188 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:12.585090 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4e8e688c-6638-40b5-ba53-0e205f399188 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:12.585522 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4e8e688c-6638-40b5-ba53-0e205f399188 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:12.724585 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-4e8e688c-6638-40b5-ba53-0e205f399188 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:07:12.730047 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4e8e688c-6638-40b5-ba53-0e205f399188 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d" status: 200 len: 1265 microversion: 2.1 time: 0.160947 Aug 24 04:07:12.730911 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 568/1141] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:07:12 2022] GET /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:07:13.751896 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-84e8e2fe-30c9-4894-af2a-1d6ab9b58139 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:13.753090 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-84e8e2fe-30c9-4894-af2a-1d6ab9b58139 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:07:13.760401 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-84e8e2fe-30c9-4894-af2a-1d6ab9b58139 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:13.760944 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-84e8e2fe-30c9-4894-af2a-1d6ab9b58139 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:13.761474 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-84e8e2fe-30c9-4894-af2a-1d6ab9b58139 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:13.762301 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-84e8e2fe-30c9-4894-af2a-1d6ab9b58139 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:13.762852 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-84e8e2fe-30c9-4894-af2a-1d6ab9b58139 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:13.763392 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-84e8e2fe-30c9-4894-af2a-1d6ab9b58139 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:14.065496 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-84e8e2fe-30c9-4894-af2a-1d6ab9b58139 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:07:14.073651 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-84e8e2fe-30c9-4894-af2a-1d6ab9b58139 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d" status: 200 len: 1265 microversion: 2.1 time: 0.326538 Aug 24 04:07:14.074473 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 574/1142] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:07:13 2022] GET /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d => generated 1265 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:07:15.097551 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-56295dc6-9e1d-424f-b382-efc2a3e9188c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:15.098091 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-56295dc6-9e1d-424f-b382-efc2a3e9188c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:07:15.104802 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-56295dc6-9e1d-424f-b382-efc2a3e9188c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:15.105288 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-56295dc6-9e1d-424f-b382-efc2a3e9188c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:15.105862 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-56295dc6-9e1d-424f-b382-efc2a3e9188c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:15.106585 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-56295dc6-9e1d-424f-b382-efc2a3e9188c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:15.107043 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-56295dc6-9e1d-424f-b382-efc2a3e9188c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:15.107469 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-56295dc6-9e1d-424f-b382-efc2a3e9188c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:15.605550 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-56295dc6-9e1d-424f-b382-efc2a3e9188c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:07:15.615083 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-56295dc6-9e1d-424f-b382-efc2a3e9188c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d" status: 200 len: 1265 microversion: 2.1 time: 0.522018 Aug 24 04:07:15.616275 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 569/1143] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:07:15 2022] GET /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d => generated 1265 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:07:15.815440 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-1ba9bcf5-0bba-4a50-bb69-cc9266004cc5 req-94c03599-4e6f-42b8-8bf9-98ba3ecc4295 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d", "name": "network-vif-plugged", "status": "completed", "tag": "21a3dbf8-8653-41f4-8fea-d2ace7b0a087"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:07:15.826921 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-1ba9bcf5-0bba-4a50-bb69-cc9266004cc5 req-94c03599-4e6f-42b8-8bf9-98ba3ecc4295 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:15.827699 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-1ba9bcf5-0bba-4a50-bb69-cc9266004cc5 req-94c03599-4e6f-42b8-8bf9-98ba3ecc4295 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:15.828135 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-1ba9bcf5-0bba-4a50-bb69-cc9266004cc5 req-94c03599-4e6f-42b8-8bf9-98ba3ecc4295 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:15.847947 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-1ba9bcf5-0bba-4a50-bb69-cc9266004cc5 req-94c03599-4e6f-42b8-8bf9-98ba3ecc4295 service nova] Creating event network-vif-plugged:21a3dbf8-8653-41f4-8fea-d2ace7b0a087 for instance 5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d on hv-cinder-85426 Aug 24 04:07:15.849571 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-1ba9bcf5-0bba-4a50-bb69-cc9266004cc5 req-94c03599-4e6f-42b8-8bf9-98ba3ecc4295 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041477 Aug 24 04:07:15.850174 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 575/1144] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 04:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:07:16.641667 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-3dbd1e40-6e28-4944-83a3-d11a6965d485 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:16.642699 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-3dbd1e40-6e28-4944-83a3-d11a6965d485 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:07:16.649408 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3dbd1e40-6e28-4944-83a3-d11a6965d485 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:16.649898 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3dbd1e40-6e28-4944-83a3-d11a6965d485 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:16.650384 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3dbd1e40-6e28-4944-83a3-d11a6965d485 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:16.655330 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3dbd1e40-6e28-4944-83a3-d11a6965d485 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:16.655330 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3dbd1e40-6e28-4944-83a3-d11a6965d485 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:16.655330 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-3dbd1e40-6e28-4944-83a3-d11a6965d485 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:16.823065 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-3dbd1e40-6e28-4944-83a3-d11a6965d485 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:07:16.832048 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-3dbd1e40-6e28-4944-83a3-d11a6965d485 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d" status: 200 len: 1265 microversion: 2.1 time: 0.197872 Aug 24 04:07:16.832638 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 570/1145] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:07:16 2022] GET /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:07:17.853339 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-c279489c-8457-4eda-9ef0-7cd1b4c8c1a8 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:17.854072 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-c279489c-8457-4eda-9ef0-7cd1b4c8c1a8 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:07:17.861126 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c279489c-8457-4eda-9ef0-7cd1b4c8c1a8 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:17.862598 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c279489c-8457-4eda-9ef0-7cd1b4c8c1a8 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:17.863183 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c279489c-8457-4eda-9ef0-7cd1b4c8c1a8 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:17.863867 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c279489c-8457-4eda-9ef0-7cd1b4c8c1a8 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:17.864555 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c279489c-8457-4eda-9ef0-7cd1b4c8c1a8 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:17.864982 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-c279489c-8457-4eda-9ef0-7cd1b4c8c1a8 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:18.054932 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-c279489c-8457-4eda-9ef0-7cd1b4c8c1a8 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:07:18.063365 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-c279489c-8457-4eda-9ef0-7cd1b4c8c1a8 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d" status: 200 len: 1453 microversion: 2.1 time: 0.214186 Aug 24 04:07:18.076722 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 576/1146] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:07:17 2022] GET /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d => generated 1453 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:07:18.084525 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-62b93931-bcf9-4d18-b54b-2b39883461b7 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:18.085143 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-62b93931-bcf9-4d18-b54b-2b39883461b7 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:07:18.091633 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62b93931-bcf9-4d18-b54b-2b39883461b7 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:18.092121 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62b93931-bcf9-4d18-b54b-2b39883461b7 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:18.092712 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62b93931-bcf9-4d18-b54b-2b39883461b7 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:18.093418 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62b93931-bcf9-4d18-b54b-2b39883461b7 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:18.093874 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62b93931-bcf9-4d18-b54b-2b39883461b7 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:18.094301 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-62b93931-bcf9-4d18-b54b-2b39883461b7 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:18.254152 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-62b93931-bcf9-4d18-b54b-2b39883461b7 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:07:18.269058 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-62b93931-bcf9-4d18-b54b-2b39883461b7 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d" status: 200 len: 1453 microversion: 2.1 time: 0.188804 Aug 24 04:07:18.283183 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 571/1147] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:07:18 2022] GET /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d => generated 1453 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:07:20.401033 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-11deb762-c71b-4dcb-a032-dd8c1af05d5d req-95f3eaef-d6bd-44f4-9754-52a61bb8fdde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d", "tag": "21a3dbf8-8653-41f4-8fea-d2ace7b0a087"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:07:20.413483 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-11deb762-c71b-4dcb-a032-dd8c1af05d5d req-95f3eaef-d6bd-44f4-9754-52a61bb8fdde service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:20.414178 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-11deb762-c71b-4dcb-a032-dd8c1af05d5d req-95f3eaef-d6bd-44f4-9754-52a61bb8fdde service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:20.414679 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-11deb762-c71b-4dcb-a032-dd8c1af05d5d req-95f3eaef-d6bd-44f4-9754-52a61bb8fdde service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:20.427194 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-11deb762-c71b-4dcb-a032-dd8c1af05d5d req-95f3eaef-d6bd-44f4-9754-52a61bb8fdde service nova] Creating event network-changed:21a3dbf8-8653-41f4-8fea-d2ace7b0a087 for instance 5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d on hv-cinder-85426 Aug 24 04:07:20.432725 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-11deb762-c71b-4dcb-a032-dd8c1af05d5d req-95f3eaef-d6bd-44f4-9754-52a61bb8fdde service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035245 Aug 24 04:07:20.433499 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 577/1148] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 04:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:08:49.205283 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:08:49.206300 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG dbcounter [-] [127870] Writing DB stats nova_cell1:SELECT=85 {{(pid=127870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:08:49.207704 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:08:49.209016 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG dbcounter [-] [127869] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:08:49.210691 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-bb9a9e40-ee73-479a-b60c-1d7f791ed8e8 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:49.211192 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bb9a9e40-ee73-479a-b60c-1d7f791ed8e8 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:08:49.218113 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb9a9e40-ee73-479a-b60c-1d7f791ed8e8 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:49.218640 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb9a9e40-ee73-479a-b60c-1d7f791ed8e8 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:49.219109 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb9a9e40-ee73-479a-b60c-1d7f791ed8e8 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:49.219893 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb9a9e40-ee73-479a-b60c-1d7f791ed8e8 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:49.220351 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb9a9e40-ee73-479a-b60c-1d7f791ed8e8 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:49.221213 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-bb9a9e40-ee73-479a-b60c-1d7f791ed8e8 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:49.249975 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-bb9a9e40-ee73-479a-b60c-1d7f791ed8e8 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:08:49.347315 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-3786e4f5-4876-461f-a4a5-b62afab68dfd req-c89e9d5d-5672-4584-afa0-5903785fe59d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d", "tag": "21a3dbf8-8653-41f4-8fea-d2ace7b0a087"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:08:49.357641 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-3786e4f5-4876-461f-a4a5-b62afab68dfd req-c89e9d5d-5672-4584-afa0-5903785fe59d service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:49.358202 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-3786e4f5-4876-461f-a4a5-b62afab68dfd req-c89e9d5d-5672-4584-afa0-5903785fe59d service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:49.358731 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-3786e4f5-4876-461f-a4a5-b62afab68dfd req-c89e9d5d-5672-4584-afa0-5903785fe59d service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:49.370701 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-3786e4f5-4876-461f-a4a5-b62afab68dfd req-c89e9d5d-5672-4584-afa0-5903785fe59d service nova] Creating event network-changed:21a3dbf8-8653-41f4-8fea-d2ace7b0a087 for instance 5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d on hv-cinder-85426 Aug 24 04:08:49.375861 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-3786e4f5-4876-461f-a4a5-b62afab68dfd req-c89e9d5d-5672-4584-afa0-5903785fe59d service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170251 Aug 24 04:08:49.376451 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 578/1149] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 04:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:08:49.625229 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-bb9a9e40-ee73-479a-b60c-1d7f791ed8e8 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "DELETE /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d" status: 204 len: 0 microversion: 2.1 time: 0.421670 Aug 24 04:08:49.625818 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 572/1150] 10.222.0.82 () {58 vars in 1239 bytes} [Wed Aug 24 04:08:49 2022] DELETE /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:08:49.636878 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-fc7047b2-5fad-495c-a3ba-4929441aa8ab tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:49.637565 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-fc7047b2-5fad-495c-a3ba-4929441aa8ab tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:08:49.644134 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-fc7047b2-5fad-495c-a3ba-4929441aa8ab tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:49.644610 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-fc7047b2-5fad-495c-a3ba-4929441aa8ab tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:49.645118 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-fc7047b2-5fad-495c-a3ba-4929441aa8ab tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:49.645887 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-fc7047b2-5fad-495c-a3ba-4929441aa8ab tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:49.646290 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-fc7047b2-5fad-495c-a3ba-4929441aa8ab tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:49.646721 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-fc7047b2-5fad-495c-a3ba-4929441aa8ab tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:49.852359 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-fc7047b2-5fad-495c-a3ba-4929441aa8ab tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:08:49.860813 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-fc7047b2-5fad-495c-a3ba-4929441aa8ab tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d" status: 200 len: 1577 microversion: 2.1 time: 0.230576 Aug 24 04:08:49.861427 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 579/1151] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:08:49 2022] GET /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d => generated 1577 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:08:50.882929 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-f184d8eb-ff8b-4943-9ee6-9ab304794fad tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:50.883741 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-f184d8eb-ff8b-4943-9ee6-9ab304794fad tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:08:50.891850 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f184d8eb-ff8b-4943-9ee6-9ab304794fad tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:50.893044 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f184d8eb-ff8b-4943-9ee6-9ab304794fad tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:50.893541 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f184d8eb-ff8b-4943-9ee6-9ab304794fad tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:50.894251 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f184d8eb-ff8b-4943-9ee6-9ab304794fad tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:50.894758 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f184d8eb-ff8b-4943-9ee6-9ab304794fad tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:50.895167 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-f184d8eb-ff8b-4943-9ee6-9ab304794fad tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:51.112162 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-f184d8eb-ff8b-4943-9ee6-9ab304794fad tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:08:51.120078 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-f184d8eb-ff8b-4943-9ee6-9ab304794fad tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d" status: 200 len: 1577 microversion: 2.1 time: 0.241732 Aug 24 04:08:51.120657 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 573/1152] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:08:50 2022] GET /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d => generated 1577 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:08:51.876980 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-99580096-e5a0-4807-a673-670bc94cfe84 req-33cd0093-0040-4430-964f-c7b3c03b0918 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d", "name": "network-vif-deleted", "tag": "21a3dbf8-8653-41f4-8fea-d2ace7b0a087"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:08:51.888175 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-99580096-e5a0-4807-a673-670bc94cfe84 req-33cd0093-0040-4430-964f-c7b3c03b0918 service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:51.888639 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-99580096-e5a0-4807-a673-670bc94cfe84 req-33cd0093-0040-4430-964f-c7b3c03b0918 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:51.889060 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-99580096-e5a0-4807-a673-670bc94cfe84 req-33cd0093-0040-4430-964f-c7b3c03b0918 service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:51.901133 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-99580096-e5a0-4807-a673-670bc94cfe84 req-33cd0093-0040-4430-964f-c7b3c03b0918 service nova] Creating event network-vif-deleted:21a3dbf8-8653-41f4-8fea-d2ace7b0a087 for instance 5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d on hv-cinder-85426 Aug 24 04:08:51.905979 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-99580096-e5a0-4807-a673-670bc94cfe84 req-33cd0093-0040-4430-964f-c7b3c03b0918 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088175 Aug 24 04:08:51.906761 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 580/1153] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 04:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:08:52.141593 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2b20969b-92c5-4b23-a8cd-302e48df8641 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:52.142206 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2b20969b-92c5-4b23-a8cd-302e48df8641 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:08:52.148894 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2b20969b-92c5-4b23-a8cd-302e48df8641 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:52.149299 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2b20969b-92c5-4b23-a8cd-302e48df8641 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:52.149737 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2b20969b-92c5-4b23-a8cd-302e48df8641 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:52.150872 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2b20969b-92c5-4b23-a8cd-302e48df8641 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:52.151399 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2b20969b-92c5-4b23-a8cd-302e48df8641 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:52.151825 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2b20969b-92c5-4b23-a8cd-302e48df8641 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:52.224054 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-2b20969b-92c5-4b23-a8cd-302e48df8641 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:08:52.236854 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2b20969b-92c5-4b23-a8cd-302e48df8641 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d" status: 200 len: 1224 microversion: 2.1 time: 0.099074 Aug 24 04:08:52.237449 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 574/1154] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:08:52 2022] GET /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:08:53.258623 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-900d7d7a-6d26-452a-9137-f2368d781c8e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:53.259391 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-900d7d7a-6d26-452a-9137-f2368d781c8e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:08:53.265620 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-900d7d7a-6d26-452a-9137-f2368d781c8e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:53.272398 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-900d7d7a-6d26-452a-9137-f2368d781c8e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:53.272398 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-900d7d7a-6d26-452a-9137-f2368d781c8e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:53.272398 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-900d7d7a-6d26-452a-9137-f2368d781c8e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:53.272398 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-900d7d7a-6d26-452a-9137-f2368d781c8e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:53.272895 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-900d7d7a-6d26-452a-9137-f2368d781c8e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:53.282488 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.wsgi [None req-900d7d7a-6d26-452a-9137-f2368d781c8e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] HTTP exception thrown: Instance 5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d could not be found. Aug 24 04:08:53.284166 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-900d7d7a-6d26-452a-9137-f2368d781c8e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Request method failure captured: Aug 24 04:08:53.284166 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: request: GET /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d HTTP/1.1 Aug 24 04:08:53.284166 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept: application/json Aug 24 04:08:53.284166 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept-Encoding: identity Aug 24 04:08:53.284166 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Connection: close Aug 24 04:08:53.284166 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Length: 0 Aug 24 04:08:53.284166 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Type: application/json Aug 24 04:08:53.284166 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Host: 10.222.0.82 Aug 24 04:08:53.284166 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Openstack-System-Scope: None Aug 24 04:08:53.284166 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: User-Agent: python-urllib3/1.26.11 Aug 24 04:08:53.284166 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Auth-Token: gAAAAABjBaK674QuAsdsIy7jRfgDNmoTzChvjwsgjWf_IBSa90n_BCEIeO6wVcFMf7aCdbHPnt8SInM4y4J-T7NCWS0JsD3SUrC6jr2qQmCLsvy_w7njCxyW3gzpGPGLOuABIGSctaY6-CBYSGx_bvbe1R42jqqJTN0CtxAD2loqE5FkuTr5QF8 Aug 24 04:08:53.284166 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Id: None Aug 24 04:08:53.284166 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Name: None Aug 24 04:08:53.284166 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Identity-Status: Confirmed Aug 24 04:08:53.284166 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Is-Admin-Project: True Aug 24 04:08:53.284166 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Id: default Aug 24 04:08:53.284166 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Name: Default Aug 24 04:08:53.284166 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Id: 8d390e7ad1454a8182258cd72bea4fa5 Aug 24 04:08:53.284166 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Name: tempest-TestVolumeBootPattern-2114603980 Aug 24 04:08:53.284166 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Role: member,reader Aug 24 04:08:53.284166 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Roles: member,reader Aug 24 04:08:53.286053 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/8d390e7ad1454a8182258cd72bea4fa5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/8d390e7ad1454a8182258cd72bea4fa5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/8d390e7ad1454a8182258cd72bea4fa5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_8d390e7ad1454a8182258cd72bea4fa5", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 04:08:53.286053 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant: tempest-TestVolumeBootPattern-2114603980 Aug 24 04:08:53.286053 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Id: 8d390e7ad1454a8182258cd72bea4fa5 Aug 24 04:08:53.286053 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Name: tempest-TestVolumeBootPattern-2114603980 Aug 24 04:08:53.286053 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User: tempest-TestVolumeBootPattern-2114603980-project Aug 24 04:08:53.286053 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Id: default Aug 24 04:08:53.286053 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Name: Default Aug 24 04:08:53.286053 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Id: 34d452ce6a1245c192acf8c87651fe92 Aug 24 04:08:53.286053 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Name: tempest-TestVolumeBootPattern-2114603980-project Aug 24 04:08:53.286053 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: method: > Aug 24 04:08:53.286053 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: exception: Instance 5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d could not be found. Aug 24 04:08:53.286053 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: action_args: {'id': '5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d'} Aug 24 04:08:53.287246 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:08:53.287246 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:08:53.287246 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:08:53.287246 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:08:53.287246 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:08:53.287246 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:08:53.287246 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:08:53.287246 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:08:53.287246 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:08:53.287246 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:08:53.287246 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d could not be found. Aug 24 04:08:53.287246 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 04:08:53.287246 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:08:53.287246 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 04:08:53.287246 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:08:53.287246 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:08:53.287246 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:08:53.287246 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:08:53.287246 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:08:53.287246 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:08:53.289140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:08:53.289140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:08:53.289140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:08:53.289140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:08:53.289140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:08:53.289140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:08:53.289140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:08:53.289140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d could not be found. Aug 24 04:08:53.289140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 04:08:53.289140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:08:53.289140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 04:08:53.289140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:08:53.289140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:08:53.289140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:08:53.289140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:08:53.289140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:08:53.289140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d could not be found. Aug 24 04:08:53.289140 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 04:08:53.292055 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-900d7d7a-6d26-452a-9137-f2368d781c8e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Returning 404 to user: Instance 5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d could not be found. {{(pid=127869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:08:53.292055 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-900d7d7a-6d26-452a-9137-f2368d781c8e tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d" status: 404 len: 111 microversion: 2.1 time: 0.032091 Aug 24 04:08:53.292055 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 581/1155] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:08:53 2022] GET /compute/v2.1/servers/5b6fd4ee-3cb0-4527-ae7e-db8d6e72814d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:08:56.644553 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-2ae269d8-1773-4f4d-af8d-afed81a4207c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:56.645043 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2ae269d8-1773-4f4d-af8d-afed81a4207c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 3ae1189b-ce08-4b70-9eaa-e7c9efb191a2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:08:56.648984 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-3e080543-00b3-484a-913f-4f41d60dbece req-84f76dd2-7fb1-4bdd-8e54-1868e036f35b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ae1189b-ce08-4b70-9eaa-e7c9efb191a2", "tag": "ade9c2d9-0ec3-430c-84bc-adbe62716f2c"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:08:56.652276 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ae269d8-1773-4f4d-af8d-afed81a4207c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:56.652837 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ae269d8-1773-4f4d-af8d-afed81a4207c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:56.653268 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ae269d8-1773-4f4d-af8d-afed81a4207c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:56.654157 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ae269d8-1773-4f4d-af8d-afed81a4207c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:56.654638 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ae269d8-1773-4f4d-af8d-afed81a4207c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:56.655066 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-2ae269d8-1773-4f4d-af8d-afed81a4207c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:56.661498 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-3e080543-00b3-484a-913f-4f41d60dbece req-84f76dd2-7fb1-4bdd-8e54-1868e036f35b service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:56.662238 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-3e080543-00b3-484a-913f-4f41d60dbece req-84f76dd2-7fb1-4bdd-8e54-1868e036f35b service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:56.662694 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-3e080543-00b3-484a-913f-4f41d60dbece req-84f76dd2-7fb1-4bdd-8e54-1868e036f35b service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:56.675268 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-3e080543-00b3-484a-913f-4f41d60dbece req-84f76dd2-7fb1-4bdd-8e54-1868e036f35b service nova] Creating event network-changed:ade9c2d9-0ec3-430c-84bc-adbe62716f2c for instance 3ae1189b-ce08-4b70-9eaa-e7c9efb191a2 on hv-cinder-85426 Aug 24 04:08:56.680490 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-3e080543-00b3-484a-913f-4f41d60dbece req-84f76dd2-7fb1-4bdd-8e54-1868e036f35b service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037383 Aug 24 04:08:56.681795 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 582/1156] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 04:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:08:56.682361 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-2ae269d8-1773-4f4d-af8d-afed81a4207c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 3ae1189b-ce08-4b70-9eaa-e7c9efb191a2] Going to try to terminate instance {{(pid=127870) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:08:56.966995 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-2ae269d8-1773-4f4d-af8d-afed81a4207c tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "DELETE /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2" status: 204 len: 0 microversion: 2.1 time: 0.325798 Aug 24 04:08:56.967691 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 575/1157] 10.222.0.82 () {58 vars in 1239 bytes} [Wed Aug 24 04:08:56 2022] DELETE /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:08:56.977370 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-bdb6d859-de53-4da4-b371-5db531842331 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:56.979589 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-bdb6d859-de53-4da4-b371-5db531842331 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 3ae1189b-ce08-4b70-9eaa-e7c9efb191a2] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:08:56.986115 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bdb6d859-de53-4da4-b371-5db531842331 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:56.986635 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bdb6d859-de53-4da4-b371-5db531842331 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:56.987072 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bdb6d859-de53-4da4-b371-5db531842331 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:56.987772 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bdb6d859-de53-4da4-b371-5db531842331 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:56.988225 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bdb6d859-de53-4da4-b371-5db531842331 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:56.988648 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-bdb6d859-de53-4da4-b371-5db531842331 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:57.129269 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.policy [None req-bdb6d859-de53-4da4-b371-5db531842331 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:08:57.138681 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-bdb6d859-de53-4da4-b371-5db531842331 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2" status: 200 len: 1578 microversion: 2.1 time: 0.165800 Aug 24 04:08:57.139269 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 583/1158] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:08:56 2022] GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2 => generated 1578 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:08:57.532471 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:08:57.532716 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Wed Aug 24 04:08:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:08:58.161648 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-669b93a7-12b7-4412-b6a7-0976313b14a9 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:58.162436 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-669b93a7-12b7-4412-b6a7-0976313b14a9 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 3ae1189b-ce08-4b70-9eaa-e7c9efb191a2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:08:58.170492 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-669b93a7-12b7-4412-b6a7-0976313b14a9 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:58.171011 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-669b93a7-12b7-4412-b6a7-0976313b14a9 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:58.171447 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-669b93a7-12b7-4412-b6a7-0976313b14a9 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:58.172177 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-669b93a7-12b7-4412-b6a7-0976313b14a9 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:58.172630 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-669b93a7-12b7-4412-b6a7-0976313b14a9 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:58.173057 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-669b93a7-12b7-4412-b6a7-0976313b14a9 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:58.311791 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-669b93a7-12b7-4412-b6a7-0976313b14a9 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:08:58.319686 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-669b93a7-12b7-4412-b6a7-0976313b14a9 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2" status: 200 len: 1578 microversion: 2.1 time: 0.162375 Aug 24 04:08:58.320731 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 576/1159] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:08:58 2022] GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2 => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:08:59.168234 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [req-96ff40e4-5701-4ae5-94c4-bf4a60ba396e req-95e458cc-becd-41ec-8340-89bc0e302b0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ae1189b-ce08-4b70-9eaa-e7c9efb191a2", "name": "network-vif-deleted", "tag": "ade9c2d9-0ec3-430c-84bc-adbe62716f2c"}]} {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:08:59.178182 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-96ff40e4-5701-4ae5-94c4-bf4a60ba396e req-95e458cc-becd-41ec-8340-89bc0e302b0d service nova] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:59.178710 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-96ff40e4-5701-4ae5-94c4-bf4a60ba396e req-95e458cc-becd-41ec-8340-89bc0e302b0d service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:59.179164 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [req-96ff40e4-5701-4ae5-94c4-bf4a60ba396e req-95e458cc-becd-41ec-8340-89bc0e302b0d service nova] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:59.190489 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.compute.server_external_events [req-96ff40e4-5701-4ae5-94c4-bf4a60ba396e req-95e458cc-becd-41ec-8340-89bc0e302b0d service nova] Creating event network-vif-deleted:ade9c2d9-0ec3-430c-84bc-adbe62716f2c for instance 3ae1189b-ce08-4b70-9eaa-e7c9efb191a2 on hv-cinder-85426 Aug 24 04:08:59.195214 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [req-96ff40e4-5701-4ae5-94c4-bf4a60ba396e req-95e458cc-becd-41ec-8340-89bc0e302b0d service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030800 Aug 24 04:08:59.195778 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 584/1160] 10.222.0.82 () {64 vars in 1317 bytes} [Wed Aug 24 04:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:08:59.341506 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-4f6f22cb-a672-4259-b026-3c46ef1cfabb tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:59.342100 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-4f6f22cb-a672-4259-b026-3c46ef1cfabb tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 3ae1189b-ce08-4b70-9eaa-e7c9efb191a2] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:08:59.348829 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f6f22cb-a672-4259-b026-3c46ef1cfabb tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:59.349307 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f6f22cb-a672-4259-b026-3c46ef1cfabb tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:59.349737 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f6f22cb-a672-4259-b026-3c46ef1cfabb tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:59.350419 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f6f22cb-a672-4259-b026-3c46ef1cfabb tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:59.350889 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f6f22cb-a672-4259-b026-3c46ef1cfabb tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:59.351334 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-4f6f22cb-a672-4259-b026-3c46ef1cfabb tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:59.419031 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.policy [None req-4f6f22cb-a672-4259-b026-3c46ef1cfabb tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d452ce6a1245c192acf8c87651fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d390e7ad1454a8182258cd72bea4fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:08:59.426867 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-4f6f22cb-a672-4259-b026-3c46ef1cfabb tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2" status: 200 len: 1225 microversion: 2.1 time: 0.090072 Aug 24 04:08:59.427435 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 577/1161] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:08:59 2022] GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:09:00.228306 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:09:00.228904 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Wed Aug 24 04:09:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:09:00.450454 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-f0110000-2120-4712-9e35-47d50b2f2a4b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:00.451198 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-f0110000-2120-4712-9e35-47d50b2f2a4b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 3ae1189b-ce08-4b70-9eaa-e7c9efb191a2] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:00.457731 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f0110000-2120-4712-9e35-47d50b2f2a4b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:00.461854 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f0110000-2120-4712-9e35-47d50b2f2a4b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:00.461854 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f0110000-2120-4712-9e35-47d50b2f2a4b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:00.461854 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f0110000-2120-4712-9e35-47d50b2f2a4b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:00.461854 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f0110000-2120-4712-9e35-47d50b2f2a4b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:00.462606 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-f0110000-2120-4712-9e35-47d50b2f2a4b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:00.474026 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.wsgi [None req-f0110000-2120-4712-9e35-47d50b2f2a4b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] HTTP exception thrown: Instance 3ae1189b-ce08-4b70-9eaa-e7c9efb191a2 could not be found. Aug 24 04:09:00.475697 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-f0110000-2120-4712-9e35-47d50b2f2a4b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Request method failure captured: Aug 24 04:09:00.475697 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: request: GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2 HTTP/1.1 Aug 24 04:09:00.475697 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept: application/json Aug 24 04:09:00.475697 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept-Encoding: identity Aug 24 04:09:00.475697 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Connection: close Aug 24 04:09:00.475697 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Length: 0 Aug 24 04:09:00.475697 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Type: application/json Aug 24 04:09:00.475697 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Host: 10.222.0.82 Aug 24 04:09:00.475697 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Openstack-System-Scope: None Aug 24 04:09:00.475697 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: User-Agent: python-urllib3/1.26.11 Aug 24 04:09:00.475697 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Auth-Token: gAAAAABjBaK674QuAsdsIy7jRfgDNmoTzChvjwsgjWf_IBSa90n_BCEIeO6wVcFMf7aCdbHPnt8SInM4y4J-T7NCWS0JsD3SUrC6jr2qQmCLsvy_w7njCxyW3gzpGPGLOuABIGSctaY6-CBYSGx_bvbe1R42jqqJTN0CtxAD2loqE5FkuTr5QF8 Aug 24 04:09:00.475697 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Id: None Aug 24 04:09:00.475697 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Name: None Aug 24 04:09:00.475697 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Identity-Status: Confirmed Aug 24 04:09:00.475697 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Is-Admin-Project: True Aug 24 04:09:00.475697 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Id: default Aug 24 04:09:00.475697 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Name: Default Aug 24 04:09:00.475697 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Id: 8d390e7ad1454a8182258cd72bea4fa5 Aug 24 04:09:00.475697 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Name: tempest-TestVolumeBootPattern-2114603980 Aug 24 04:09:00.475697 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Role: member,reader Aug 24 04:09:00.475697 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Roles: member,reader Aug 24 04:09:00.477318 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/8d390e7ad1454a8182258cd72bea4fa5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/8d390e7ad1454a8182258cd72bea4fa5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/8d390e7ad1454a8182258cd72bea4fa5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_8d390e7ad1454a8182258cd72bea4fa5", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 04:09:00.477318 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant: tempest-TestVolumeBootPattern-2114603980 Aug 24 04:09:00.477318 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Id: 8d390e7ad1454a8182258cd72bea4fa5 Aug 24 04:09:00.477318 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Name: tempest-TestVolumeBootPattern-2114603980 Aug 24 04:09:00.477318 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User: tempest-TestVolumeBootPattern-2114603980-project Aug 24 04:09:00.477318 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Id: default Aug 24 04:09:00.477318 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Name: Default Aug 24 04:09:00.477318 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Id: 34d452ce6a1245c192acf8c87651fe92 Aug 24 04:09:00.477318 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Name: tempest-TestVolumeBootPattern-2114603980-project Aug 24 04:09:00.477318 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: method: > Aug 24 04:09:00.477318 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: exception: Instance 3ae1189b-ce08-4b70-9eaa-e7c9efb191a2 could not be found. Aug 24 04:09:00.477318 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: action_args: {'id': '3ae1189b-ce08-4b70-9eaa-e7c9efb191a2'} Aug 24 04:09:00.479262 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:09:00.479262 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:09:00.479262 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:09:00.479262 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:09:00.479262 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:09:00.479262 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:09:00.479262 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:09:00.479262 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:09:00.479262 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:09:00.479262 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:09:00.479262 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ae1189b-ce08-4b70-9eaa-e7c9efb191a2 could not be found. Aug 24 04:09:00.479262 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 04:09:00.479262 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:09:00.479262 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 04:09:00.479262 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:09:00.479262 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:09:00.479262 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:09:00.479262 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:09:00.479262 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:09:00.479262 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:09:00.481274 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:09:00.481274 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:09:00.481274 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:09:00.481274 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:09:00.481274 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:09:00.481274 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:09:00.481274 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:09:00.481274 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ae1189b-ce08-4b70-9eaa-e7c9efb191a2 could not be found. Aug 24 04:09:00.481274 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 04:09:00.481274 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:09:00.481274 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 04:09:00.481274 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:09:00.481274 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:09:00.481274 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:09:00.481274 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:09:00.481274 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:09:00.481274 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ae1189b-ce08-4b70-9eaa-e7c9efb191a2 could not be found. Aug 24 04:09:00.481274 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 04:09:00.496531 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-f0110000-2120-4712-9e35-47d50b2f2a4b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Returning 404 to user: Instance 3ae1189b-ce08-4b70-9eaa-e7c9efb191a2 could not be found. {{(pid=127869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:09:00.496531 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-f0110000-2120-4712-9e35-47d50b2f2a4b tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2" status: 404 len: 111 microversion: 2.1 time: 0.031605 Aug 24 04:09:00.496531 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 585/1162] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:09:00 2022] GET /compute/v2.1/servers/3ae1189b-ce08-4b70-9eaa-e7c9efb191a2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:09:01.001762 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b31b7c2e-1a35-4a54-8e61-781e173eb17d tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:01.002336 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.compute.api [None req-b31b7c2e-1a35-4a54-8e61-781e173eb17d tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 50398eec-9c47-426e-bf0b-3e1e8ed38f55] Fetching instance by UUID {{(pid=127870) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:01.008873 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b31b7c2e-1a35-4a54-8e61-781e173eb17d tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:01.010638 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b31b7c2e-1a35-4a54-8e61-781e173eb17d tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:01.011102 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b31b7c2e-1a35-4a54-8e61-781e173eb17d tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:01.011787 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b31b7c2e-1a35-4a54-8e61-781e173eb17d tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:01.012263 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b31b7c2e-1a35-4a54-8e61-781e173eb17d tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:01.012677 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG oslo_concurrency.lockutils [None req-b31b7c2e-1a35-4a54-8e61-781e173eb17d tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:01.027296 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.wsgi [None req-b31b7c2e-1a35-4a54-8e61-781e173eb17d tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] HTTP exception thrown: Instance 50398eec-9c47-426e-bf0b-3e1e8ed38f55 could not be found. Aug 24 04:09:01.028963 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b31b7c2e-1a35-4a54-8e61-781e173eb17d tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Request method failure captured: Aug 24 04:09:01.028963 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: request: DELETE /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55 HTTP/1.1 Aug 24 04:09:01.028963 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept: application/json Aug 24 04:09:01.028963 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Accept-Encoding: identity Aug 24 04:09:01.028963 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Connection: close Aug 24 04:09:01.028963 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Length: 0 Aug 24 04:09:01.028963 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Content-Type: application/json Aug 24 04:09:01.028963 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Host: 10.222.0.82 Aug 24 04:09:01.028963 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Openstack-System-Scope: None Aug 24 04:09:01.028963 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: User-Agent: python-urllib3/1.26.11 Aug 24 04:09:01.028963 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Auth-Token: gAAAAABjBaK674QuAsdsIy7jRfgDNmoTzChvjwsgjWf_IBSa90n_BCEIeO6wVcFMf7aCdbHPnt8SInM4y4J-T7NCWS0JsD3SUrC6jr2qQmCLsvy_w7njCxyW3gzpGPGLOuABIGSctaY6-CBYSGx_bvbe1R42jqqJTN0CtxAD2loqE5FkuTr5QF8 Aug 24 04:09:01.028963 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Id: None Aug 24 04:09:01.028963 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Domain-Name: None Aug 24 04:09:01.028963 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Identity-Status: Confirmed Aug 24 04:09:01.028963 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Is-Admin-Project: True Aug 24 04:09:01.028963 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Id: default Aug 24 04:09:01.028963 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Domain-Name: Default Aug 24 04:09:01.028963 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Id: 8d390e7ad1454a8182258cd72bea4fa5 Aug 24 04:09:01.028963 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Project-Name: tempest-TestVolumeBootPattern-2114603980 Aug 24 04:09:01.028963 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Role: member,reader Aug 24 04:09:01.028963 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Roles: member,reader Aug 24 04:09:01.030735 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/8d390e7ad1454a8182258cd72bea4fa5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/8d390e7ad1454a8182258cd72bea4fa5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/8d390e7ad1454a8182258cd72bea4fa5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_8d390e7ad1454a8182258cd72bea4fa5", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 04:09:01.030735 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant: tempest-TestVolumeBootPattern-2114603980 Aug 24 04:09:01.030735 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Id: 8d390e7ad1454a8182258cd72bea4fa5 Aug 24 04:09:01.030735 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-Tenant-Name: tempest-TestVolumeBootPattern-2114603980 Aug 24 04:09:01.030735 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User: tempest-TestVolumeBootPattern-2114603980-project Aug 24 04:09:01.030735 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Id: default Aug 24 04:09:01.030735 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Domain-Name: Default Aug 24 04:09:01.030735 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Id: 34d452ce6a1245c192acf8c87651fe92 Aug 24 04:09:01.030735 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: X-User-Name: tempest-TestVolumeBootPattern-2114603980-project Aug 24 04:09:01.030735 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: method: > Aug 24 04:09:01.030735 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: exception: Instance 50398eec-9c47-426e-bf0b-3e1e8ed38f55 could not be found. Aug 24 04:09:01.030735 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: action_args: {'id': '50398eec-9c47-426e-bf0b-3e1e8ed38f55'} Aug 24 04:09:01.031698 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:09:01.031698 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:09:01.031698 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:09:01.031698 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:09:01.031698 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:09:01.031698 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:09:01.031698 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:09:01.031698 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:09:01.031698 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:09:01.031698 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:09:01.031698 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50398eec-9c47-426e-bf0b-3e1e8ed38f55 could not be found. Aug 24 04:09:01.031698 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 04:09:01.031698 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:09:01.031698 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 04:09:01.031698 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:09:01.031698 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:09:01.031698 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:09:01.031698 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:09:01.031698 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:09:01.031698 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:09:01.033126 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:09:01.033126 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 04:09:01.033126 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 04:09:01.033126 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 04:09:01.033126 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 04:09:01.033126 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:09:01.033126 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:09:01.033126 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:09:01.033126 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:09:01.033126 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50398eec-9c47-426e-bf0b-3e1e8ed38f55 could not be found. Aug 24 04:09:01.033126 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 04:09:01.033126 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:09:01.033126 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 04:09:01.033126 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:09:01.033126 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:09:01.033126 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:09:01.033126 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:09:01.033126 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:09:01.033126 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50398eec-9c47-426e-bf0b-3e1e8ed38f55 could not be found. Aug 24 04:09:01.033126 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: ERROR nova.api.openstack.wsgi Aug 24 04:09:01.034560 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-b31b7c2e-1a35-4a54-8e61-781e173eb17d tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Returning 404 to user: Instance 50398eec-9c47-426e-bf0b-3e1e8ed38f55 could not be found. {{(pid=127870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:09:01.034560 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-b31b7c2e-1a35-4a54-8e61-781e173eb17d tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "DELETE /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55" status: 404 len: 111 microversion: 2.1 time: 0.032530 Aug 24 04:09:01.034560 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 578/1163] 10.222.0.82 () {58 vars in 1239 bytes} [Wed Aug 24 04:09:00 2022] DELETE /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:09:01.039138 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-6c1e323a-77d1-49e7-a1b3-e61648c15cc6 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '>' {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:01.039747 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.compute.api [None req-6c1e323a-77d1-49e7-a1b3-e61648c15cc6 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] [instance: 50398eec-9c47-426e-bf0b-3e1e8ed38f55] Fetching instance by UUID {{(pid=127869) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:01.046136 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6c1e323a-77d1-49e7-a1b3-e61648c15cc6 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:01.046642 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6c1e323a-77d1-49e7-a1b3-e61648c15cc6 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:01.047076 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6c1e323a-77d1-49e7-a1b3-e61648c15cc6 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:01.047760 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6c1e323a-77d1-49e7-a1b3-e61648c15cc6 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Acquiring lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:01.048209 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6c1e323a-77d1-49e7-a1b3-e61648c15cc6 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:01.048628 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG oslo_concurrency.lockutils [None req-6c1e323a-77d1-49e7-a1b3-e61648c15cc6 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Lock "a161133a-c4eb-4e12-9be8-d257b8daa02d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:01.062613 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.wsgi [None req-6c1e323a-77d1-49e7-a1b3-e61648c15cc6 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] HTTP exception thrown: Instance 50398eec-9c47-426e-bf0b-3e1e8ed38f55 could not be found. Aug 24 04:09:01.064134 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-6c1e323a-77d1-49e7-a1b3-e61648c15cc6 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Request method failure captured: Aug 24 04:09:01.064134 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: request: GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55 HTTP/1.1 Aug 24 04:09:01.064134 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept: application/json Aug 24 04:09:01.064134 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Accept-Encoding: identity Aug 24 04:09:01.064134 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Connection: close Aug 24 04:09:01.064134 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Length: 0 Aug 24 04:09:01.064134 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Content-Type: application/json Aug 24 04:09:01.064134 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Host: 10.222.0.82 Aug 24 04:09:01.064134 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Openstack-System-Scope: None Aug 24 04:09:01.064134 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: User-Agent: python-urllib3/1.26.11 Aug 24 04:09:01.064134 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Auth-Token: gAAAAABjBaK674QuAsdsIy7jRfgDNmoTzChvjwsgjWf_IBSa90n_BCEIeO6wVcFMf7aCdbHPnt8SInM4y4J-T7NCWS0JsD3SUrC6jr2qQmCLsvy_w7njCxyW3gzpGPGLOuABIGSctaY6-CBYSGx_bvbe1R42jqqJTN0CtxAD2loqE5FkuTr5QF8 Aug 24 04:09:01.064134 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Id: None Aug 24 04:09:01.064134 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Domain-Name: None Aug 24 04:09:01.064134 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Identity-Status: Confirmed Aug 24 04:09:01.064134 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Is-Admin-Project: True Aug 24 04:09:01.064134 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Id: default Aug 24 04:09:01.064134 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Domain-Name: Default Aug 24 04:09:01.064134 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Id: 8d390e7ad1454a8182258cd72bea4fa5 Aug 24 04:09:01.064134 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Project-Name: tempest-TestVolumeBootPattern-2114603980 Aug 24 04:09:01.064134 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Role: member,reader Aug 24 04:09:01.064134 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Roles: member,reader Aug 24 04:09:01.065908 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/8d390e7ad1454a8182258cd72bea4fa5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/8d390e7ad1454a8182258cd72bea4fa5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/8d390e7ad1454a8182258cd72bea4fa5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_8d390e7ad1454a8182258cd72bea4fa5", "adminURL": "http://10.222.0.82:8080"}]}] Aug 24 04:09:01.065908 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant: tempest-TestVolumeBootPattern-2114603980 Aug 24 04:09:01.065908 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Id: 8d390e7ad1454a8182258cd72bea4fa5 Aug 24 04:09:01.065908 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-Tenant-Name: tempest-TestVolumeBootPattern-2114603980 Aug 24 04:09:01.065908 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User: tempest-TestVolumeBootPattern-2114603980-project Aug 24 04:09:01.065908 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Id: default Aug 24 04:09:01.065908 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Domain-Name: Default Aug 24 04:09:01.065908 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Id: 34d452ce6a1245c192acf8c87651fe92 Aug 24 04:09:01.065908 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: X-User-Name: tempest-TestVolumeBootPattern-2114603980-project Aug 24 04:09:01.065908 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: method: > Aug 24 04:09:01.065908 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: exception: Instance 50398eec-9c47-426e-bf0b-3e1e8ed38f55 could not be found. Aug 24 04:09:01.065908 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: action_args: {'id': '50398eec-9c47-426e-bf0b-3e1e8ed38f55'} Aug 24 04:09:01.066989 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: {{(pid=127869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:09:01.066989 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:09:01.066989 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:09:01.066989 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:09:01.066989 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:09:01.066989 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:09:01.066989 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:09:01.066989 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:09:01.066989 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:09:01.066989 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:09:01.066989 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50398eec-9c47-426e-bf0b-3e1e8ed38f55 could not be found. Aug 24 04:09:01.066989 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 04:09:01.066989 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:09:01.066989 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 04:09:01.066989 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:09:01.066989 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:09:01.066989 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:09:01.066989 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:09:01.066989 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:09:01.066989 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:09:01.068603 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:09:01.068603 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:09:01.068603 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:09:01.068603 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:09:01.068603 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:09:01.068603 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:09:01.068603 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:09:01.068603 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50398eec-9c47-426e-bf0b-3e1e8ed38f55 could not be found. Aug 24 04:09:01.068603 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 04:09:01.068603 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:09:01.068603 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 04:09:01.068603 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:09:01.068603 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:09:01.068603 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:09:01.068603 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:09:01.068603 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:09:01.068603 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50398eec-9c47-426e-bf0b-3e1e8ed38f55 could not be found. Aug 24 04:09:01.068603 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: ERROR nova.api.openstack.wsgi Aug 24 04:09:01.070036 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: DEBUG nova.api.openstack.wsgi [None req-6c1e323a-77d1-49e7-a1b3-e61648c15cc6 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Returning 404 to user: Instance 50398eec-9c47-426e-bf0b-3e1e8ed38f55 could not be found. {{(pid=127869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:09:01.070036 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO nova.api.openstack.requestlog [None req-6c1e323a-77d1-49e7-a1b3-e61648c15cc6 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55" status: 404 len: 111 microversion: 2.1 time: 0.030199 Aug 24 04:09:01.070036 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: [pid: 127869|app: 0|req: 586/1164] 10.222.0.82 () {58 vars in 1236 bytes} [Wed Aug 24 04:09:01 2022] GET /compute/v2.1/servers/50398eec-9c47-426e-bf0b-3e1e8ed38f55 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:09:02.590718 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: DEBUG nova.api.openstack.wsgi [None req-0d8556aa-18b0-43a0-9149-074b82bf5c83 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] Calling method '.version_select at 0x7f1554363f70>' {{(pid=127870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:02.679861 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO nova.api.openstack.requestlog [None req-0d8556aa-18b0-43a0-9149-074b82bf5c83 tempest-TestVolumeBootPattern-2114603980 tempest-TestVolumeBootPattern-2114603980-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-166112542" status: 202 len: 0 microversion: 2.1 time: 0.093858 Aug 24 04:09:02.680422 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: [pid: 127870|app: 0|req: 579/1165] 10.222.0.82 () {58 vars in 1260 bytes} [Wed Aug 24 04:09:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-166112542 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:12:17.541761 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:12:17.542546 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Wed Aug 24 04:12:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:12:20.237392 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:12:20.237952 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Wed Aug 24 04:12:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:12:21.565335 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:12:21.566102 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Wed Aug 24 04:12:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:12:22.468697 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:12:22.469325 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Wed Aug 24 04:12:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:14:17.106142 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:14:17.106888 dv-cinder-854260-1-iscsi devstack@n-api.service[127870]: Wed Aug 24 04:14:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:14:19.075744 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:14:19.076251 dv-cinder-854260-1-iscsi devstack@n-api.service[127869]: Wed Aug 24 04:14:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!